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he experim^tal Vocational Exploration in the 
Private Sector (VEPS-1) program, 1571^72 was intend e1l to -provide 
^^drop.out- prone. Neighborhood * Youth Corps (NYC)' youth wi^Wi intensive 
qounseling, supportive services and work experd^^nce in the private* 
s^ctor^. to encourage completion of liigh .school,- and to assist in ^ 
obtaining full-time employtnent upon graduation. This report is a \ 
longitudinal imjjact study bf enrollees from their selection in June, 
197t, to a point after high school graduation ,in June', 1973. The 
analysi-s indicates that' VEP3 achieved significant success in 
attaining its objectives. Outcome data^for the VEPS-I completers was 
compar.flVto siinilar data for a cont rol" group of NYC youth'. T-scofe 
tests .on change in grade point average and school attendance over the 
'1970-71 to" 1972^73 school years-.reveal statistically significant 
improvement. No difference could be observed in cqmparing ' ^-^ 
graduation/dropout rates for ^he twc groups^ although the VEPS-I 
group could have been expected to have a higher schpol dropout rate. 
VEPS-I youth achieved a statistically significant higher employment 
rate upon graduation compared to the control group- (Author) 
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: - ' BREFACE 

_^'In a series of assessmefft papers, progress reports and. final reports/ 
prepared for the U.S. .Department of Labor, the Qenter for Urban Programs-^ 
at Saint Lpuis University has attempted to document the origins, develop^ 
ment, organization, administration and impact of ±he experimental sununer/ 
in-school Vocational Explcfratioji in the PriAjate Sector (VEPS) program for * 
dropout prone NYC*youth. Specifically, the Center for^'Urban Programs wis ^ 
under contract and gr'ant obligation to monitor and ass'ess the VEPS program 
with a view toward development of ,an implementation manlial, assessment of • 
programmatic impacts on, an annual basis, and assessment of the longitudinal 
impact of the first year of VEPS \xs±ng a control ^roup selected from several 
.VEPS cities.. Over the course of the Saint Louis University'^s inyoJ.vem^nt 
withj the VPPS 'program twd implementation manuals were produced/ J/^cational 
Exploration in' the Private Sector; Model for Implementing theSt97i-73 Guide 
lines (May, 1972) , and Youtli Training in the Private Secto»; A Model for 
" Implementation' , (June, 1974777 A final report on the VEPS-I program (1971-72) 
was 'published in February7T?73, Atled ^ocational Exploration in the Pri- 
vate Se'ctor; Final Report and Assessment, 1971-22p a finar report covering 
VEPS-II* (1972-73) was prepjareS in July, 1974, entitled Vocational Explora- --^ 
tion in the Private Sector; Final Repott and Assessment, 1972-73^ Compari- 
son of Impact of the^lot'and Second Experimental Years ^ 

In addition to these formal report'^s, 4 national conference of VEPS 
program staff and Department of Labor representati'ves was held in St. LoUis 
under the auspices of the Center for Urban, Programs, N6vember 1-3, 1972^ 
Iftie proceedings of this conference^ were p^ublished in December of 1972 • 
Mid-year program? assessments were preparj^^ fpr 'the Department of Labgr on * 
January, 27, ^1972, and* May 10, 1973, wHi^ provided the basis for program-^ 
matic "decision-making on the continuation and expansion ,of the VEPS ,pro-' 
gram. Periodic interim progress repotts were also provided to the Depart-' 
ment of Labor throughout, the two year history of the VEPS experiment. This 
report is the last af the series. It attempts to re^ch a definitive as^a^sfi- 
ment of 'the VEts impact. % > - 

♦ «i • /' ■ * ' 

We are grateful for the support;, and cooperation of niimerous .individuals 
across* the nation in the collection of information anV in the production of' 
, these documents. The. VEPS program staffs in the. In^ivi^jial cities proved 
villing to endure the freq^ent^ field visits pf the Center- for Urba^ 'Programs 
monitoring t^gjjis. Aelr sugge'stions and cooperation, were invali^able' in the 
development of tfte .program m^del and the assessment of programmatic o.iitcomes 
The ^Upp(5rt/and assistance of •j^feople in the -U.S. Office of Education, the 
nationaj. office of the" National Alliance of Businessmen, and the various^ 
ifietro office^ of^NAB' also deserve mention. School officials in the various 
^districts operating VE^^S programs were also supportive of our efforts. 

' Although federal officials in tjie regional offices of the Department 
of Labor devQ;ted much time and effort to the VEPS program ami its as^ss- 
^mieiit, sp^cial^^ thanks arfe due to personnel In Washington, D.C. , especially 
Hri Joseph Seller* fomerly CKief, Division of Experimental Operations 7 
'Research, Off i^ OT^Research and Development, l^^npower Administration, whose 



earljr^ encouragement of the 



VEPS; coi 



concept and^support of the in/3nitoring and 



.'assessment was e^jttremely helpful. Mr. Thomas Briiening proved an able and 
suppbrtive successor. to Mr.* S^ilel:. ^Ms. Lo\^i-se Sco^'tt, also of the Divi- 
sion of Experimental Op^atior^'s Research .and our project officer, deserves 
special thanks folr,hi6''r encouragement, assistance , and advice, -Ms. Wendy 
, Leake, Division otf Work Experience, Manpower •'Administratixjn, prevfded yeoman 
service to Jthe VEPS program and the monitoring team.^ 

Finally,, we i/ish to acknowledge and tl^ank our colleagues at ths Center 
for Urban Programs, Saint J^ouis' University:,! for tieir support over the long ^ 
duration of this liroject. ;Oiyr Secretarial staff produced* reams of documen-" 
tation with little complaint ,* and the Yalem^Compuier Center proved capable 
of withstanding the petty grievances* of the', analysts. Each of us holds the 
o^jher responsible for- errors of i judgment or analysis • 



Saint Louis, ^Missouri 
July, 1974 



Donald ?• Sprengel 
E. i^llan Tomey 
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. - • ^ , PART I . ' • — 

INTRODUCTION TO. VEPS _. * 

As outlined in U,S, DepaTtmejit of Labor Field Memorandum No, 92-71 
(March 19t 1971) and detailed in field Memorandum No,, 183-71 (May 14, 1971) 
the U,S, Department of Labor, the'Nationai Alliance of Businessmen (NAB), 
and the Office of Education of HEW cooperated in the development arid demon-* J:^ 
stration of a full year. pilot program ^'Vocational Exploration in the Private 
Sector" (VEPS) for Neighboi^ood Youth Corps inrschopl yquth. The time 
frame df the expefrimental program was Jun6 1, i971 ,to June 30, 1972, 

'a* Description oj- the First Year VEPS Program (VEPS-I ) '* ♦ 

A3 described in Field Memorandum No. 183-71, the year- long VEPS-I* 
program was designed ^or eleventh grade, 16 year old Neighborhood Youth 

.Corps, iiT-school 'youth who could be identified as. probable dropouts. Ori- 
ginally, fourteen citieg were targeted for VEPS-I, but four sites were unr 
able to initiate programs. Two cities ~ Columb.u^,* Georgia and Portland, 
Oregon --^terminated VE?S-I after, the summer phase. The cities -that com- 
,pleted the program were: Columbus^, Ohio;fFlint, Michigan; Fort Worth, 
Texas; Lawrence and Haverhill, Massachusetts; Norfolk, Virginia; Pittsburgh, 
Pennsylvania; Salt Lake City, Utah; and S'an' Bernardino, California, De- 
veloped by the U.S, Department of Labor and the National Alliance of Busi- 
nessmen (NAB), joined by theJLL5 , ,0f f ice of Education- of HEW, the program 
provided career exploraDion and 'training opportunities that, hope'fully, " 
would result in reduction .of high school dropouts and the flow pf untrained, 

-.unskilled youth into the labor market. Primary emphasis was to be given' 
to the development of training *and career exploration opportunities in 
order txj provide enrollees with the widest possible exposure to .the ^ojI3 
of work. Training assignments were r to be. related directly to the interests 
and capabili ties of enrollees in concert with their educational goals,* 

The major components- of VEPS were as follows: " . . ^_ 

(1) Counseling and Remediation , *This component was to provide enrollees 
with the motivati^on and basic educational Skills needed to function effective- 
ly in a wqrk environment. Remedial needs were to be determined and assis- 
tance rendered ^c*cordingly , Qounseling assistance was to be provided at 
work, in school, and at home, ^ • '/ , - 

(2) Orientation ,- ^ This component was to provide enrollees with a basic 
grasp of rtie demands placed oh. the individual in the world of work, work 
attitudes and habits, an awareness of the participating company *a activities 
and company facilities, and an explication 'of the enrollees' primary ob- 
jectives wbile' in the program and the company's interest in the program, ^ 

, (3) Career Exploration , This component was to provide the opportufiity 
for enrollees to broaden their perspective of the panorama of jobs in the 
world of work, to observe others in a work environmervt, to' discuss with . / 
permanent employees the training and education needed for job success, to 
'understand the rewards arising from employment, and to learn ofi the p*ossi- 
bilities of upward mobility in^a ,given skill* f\ 
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(4) Non-ProducJ:ive On-The-Job Training . This component involved close 
supervision 'of youth entollees as they developed work ..habits and basic job 
skills and the application of those learned sk-J.lls in .the actual work en- * 
vironwent. This component was entirely non-productive on-the-job training 
at private sector worksite's. 

(5) Productive Work Experience. This program component provided actual 
work experience in production of marketable goods and services with wages 
paid entirely by. the employer. (See details below concerning "Employer 
Phase.;') • ' * 

.The first four components listed above represented program activities * 
conducted. when wages were paid to enrollees froq NYC sponsor funds — r^ 
ferted to hereafter asy^^C^Phase.'' The fi^th comijond'nt constituted the 
."Employer Phase" with wAges paid entirely by the private sector.* The full 
yean: VEPS program had three segments (summer, first school semester, and. 



second school semester), each of which had an 
Phase during the weeks designated be'^ow 



Segment 
Sumjner 

12 weeks (39 hour6 per -week) 



( 



First School Semester 

19 weeks (15 hours per' week) 

Second School Semester ? 
. 19 weeks (15 hours per week) 



NYcr Phase 



Weeks 1-6 



"rWeeks 1-15 



Weeks 1-10 



'NXC Phase". and an "Employer 
JEmployer Phase 

Week^ 7-12 

I 

Weekb 16-19 

Weeks 11-19 



to a 



wDrk 



At the start of each segment, the enrollee was to move 
station either •at his present employer or with another -empldyer. At the con- 
-clusfon of the program each enrollee was' to have had"*tlifee separate^ VEPS 
wo^k experiejices . • ' 

Youth ^rticipants in the VEPS program were .to be recruited by NYC 
"sponsors; po^biitial enrollees were to be in-school -youth ^t least 16 years 
of age who were economically disadvantaged as defined By NYC guidelines. . 
Candidates wefe to be referred to special high school counselors for certi- 
fication that the students would be 11th graders in September, 1971, and 
that they were "p-3:obable dropout's." - ' 

The special .high school counselors assigned to the p.rogram were funded 
by the U-J- Office of Education. Counselors were to 1>e selected for theit 
interest in aiding the disadvantaged rather than -objective counseling' • 
credentials, except where State regulations or union' agreements required 
fully credentialed counsej-or's . They were to devote full time tio the enrollee^s 
remediation, counseling, and career exploration needs and interests. A 
counselor-enrollee r&tio of 1:20 was to be maintained wherever jpos^sible. 
Counselors would contact and observe enrolle^et t their private sector work- 
9 sites and, at s.chool, and would assist NYC spor ^ Aid companies, in develop- 
ing' and operating several program components. 

Work Sites for enrollees were to be identified, and selectjed by N^AB metro 
offices; criteria for participating private sector companies Included a demon-' 
strated interest in training and employing in-scho9l youth, a^d a capability 
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for training^ youth personnel. The program was to be designed so as to pro- 
vide each" enrollee three separate and distinct work experiences either with- 
in the same Gompany or in different companies over the course of one year. 
As Qpnditions for participation • in the program,, a company, was to agree to 
the following: ^ ' ^ • 

. (1) Provide, at its own cost, necessary staff, §paffce, equipment,' supplie 
and acce£?s to the principal wprk^tes ; w ; 



'(2) 



Make these resotirces available to enrollees an^i liigh school counse- 



lors; an<p ^ 

f 1 • „ , • - 

(3) (Absorb the salaries 'of ' enrollees ^hen each -"NYC Phase** terminated. 

Additional responsibilities of private sector participants uuder t^rms 
of the program included^ (a) identification of training and employment posi- 
tions; (b)^ dWelopmep/t: of orientation and career exploration curricula ^it^h 
loc^l NYC and >ch€n9l of f icial,s; (c) allocatidh of sub^visory personnel to 
training and work witW erjrollees; (d) developments of prpcedures governing ' 
payrolls\ during training periods where the*employer bears ^the full cost of 
the^ enroO-lee's salary; and (e) designation of a company coordinator* to assist 
the NYC sponsor. ^nd high school counselor in developing program curriculums 
and schedules. * 

* ^ . r ^ - 

In addition to the recruitment and referral of youth functions , NYC 
sponsors were responsible 'for program administration including recolrcf keep- - 
ing, paying NYC wages to enrollees, maintaining liaison with company coordi-^ 
nators arid high schpol counselors, working with the 'metro NAB youth director 
to. provide for joint m{)nitoring, and establishing a program review Gorapiittee. 

b'. Program Objectives of VEPS ' ^ ' . 

* • 

The program objectives of VEPS were oomparable to those of the regular 
NYC In-school prosgram. > Briefly stated, these objectives were: * 
"7"" - # ^ ^ 

' ^ (1^ To provide youC^h with the incen£iye to remain in school and earn 
•a high school diploma — The V^PS project was designed for probable high * 
school dropouts. The incentive to remain in 3cnool was "to be^provided by 
iatensi^ve counseling, remediation, and work experience components that would 
demonstrate the need for an/d» value of education. ^ . 

< • . 

(2) To facilitate the smooth transition^ upoa high s-chool graduation 
into the full'-time wojk f6rce — Utilizing private sector work sites with 
three sepajrate work experien&es, coupled with career: explo^ration, the .VEPS 
program sought to provide a^^oader and more transferable NYC work*experience 
by using private rather than public sector work sites^. - . 

(3) To provide youth with part-time employmi^nt- while iti school — ^ 
major objective of \^PS-I was for employers to coijtinue 6mployin§ enrollees 
on^a full-time basis during the summer following the initial program year 
apd on a part-time basis during the enrollees' hi^ school senior year. 
.Upon graduation, it was hoped that the enrollees would be employed b^r the 
participating company as a regular full-time employee or by another employer 
seeking Tabor skills possessed by the enrcdlees* ^ 



(4) To dramatize' the need for and utility of a sound high school educa- * 
tion for success in the world 'of work — Through jexample,. experience and 
counseling it was hoped that enrollees could draw linkages betw^n the op-;^ 
portunities provided ^hrough^ formal educaf:ion with the requirements for 
emplo inability in the private sector. i • v 

C. ' The Rale of the Center for Urban Programs Saint Louis University 

' The Center for Urban* Programs (CUP) at Saint Louis University Was under 
contract (Number 82-29-71-34) to the, U.S. Department of Labor to'monitor-^ 
analyze the experimental Vocational Exploration in the Private Sector (VEPS) 
program. Under terms of the contract. CUP had the following general respon- 
sibilities: ' ' \ ' 

(1) Compare and document ^altiemative approaches for'^ea^ablishing and 
operating 'the several program components; ^ •»* , . 

■ ■ , / 

(2) Provide periodic feedback to^he Department of Labor regarding pro- 
gram operations and .problems; . T 

(3) Analyze the broad first year VEPS- experience to: (a) assess whethei: 
there were outcomes which might support continuing VEPS in its second year; 
and-'(b) 'develop'^ an improved VEPS design and guidelines for use in Summer 1972 
and thereafter; and , , • 

(4) Assess the immediate impact of VE'PS-I on the participating youth 
and agencies . ' , - c 

' ' - * * *. 

CUP monitored the'VEPS-I program and collected enrallee impact data-in 
eight of the nine participaJ^g' cities. Periodic reports, were submitted to 
the Division of Experimenta^Operations- Research of the Department of Labor*. , 
An assessment report was prepared in, January, 1972, which contained a pre- 
liminary estimate of impact onTVEPS-I enrollee^ and recommended guidelines 
. for a second program year. The experience .during the /irst year of the VEPS 
program has.|5een detailed by the Center for Urban Programs in Vocational 
Exploration in the Private. Sector : Final Report and Assessment: 1971-72 > In 
addition, a program, model Containing guidelines and implementation suggestions 
for the second year of VEPS (VEPS-II) ^^as distributed in Spring, 1972 (Voca^ ^' 
X tionil Exploration in the Private^ Sactor: Model for Implementing the 1972-73 
Guidelines ) ' to assist those programs operating during the 1972-73 school year. 

Thfe duration'of the first year study of "the VEPS program was insufficient 
to determine whether long term VEPS-I program objectives had been m§t^'"The 
stu<ly ended with. the completion of the program year. Thus, contract* termina- 
tion prevented analysis of specific questions relating to high school gradua- 
tign and future labor market participation. Most of the VEPS-I enrollees 
were in their' junior year du;ring the program year and would not move into 
the full-time -labor force until the summer of 1973. * Ultimately, the disposif 
tion of students leaving high school was the fundamental question which had • 
to be an'lwered through^ further analysis. ^. - 

« * * * - 

Effective assessment o'f VgPS-I 'dictated the nfed for a longitudinal . 
study to tompare changes in enrollee academic performance, attendance, high 
school graduation/dropout rates,* and absorption into the labQr force.- ■ For 
example, th6 goal of moving edrollees into the labor force could only be 



measured at a point in time' two years \afrer th^ VEPS-I program was. initiated. 
Therefore,' CUT needed to track VEPS-I enrollees" through the' program year, 
the summer following, the ^enior, year, and into the summer following their 
^anticipated graduation. ' . * * ^ 

Othet goals ,^ such as improved academic performance, also h^d lon^ term* 
implicatio.ns. Presumably, students whose grades were improving would be - ' 
more inkeres.ted in staying in school and, at the same time, he, in a better 
^^ition to .complete the necessary cre'dit's "f or 'graduation* In short, long-i- ^■ 
tudinal study, was required to assess the extent, to which VEPS-I goals were, 
^achieved ov^ time. - ^ 

The longitudinal tracking, of only VEPS-I enrollees wa§ incapable of 
assessing the signif icancejs^of the program due to* other ' poskib|e intervening 
variables; use o'f a control group was also required. '^S^e objectives of 
VEPS-I constituted the variably to be. considered. , Operationalization of' 
those variables provided the data sets for the analysis and assessment of 
outcomes. While it may be Suggested that more ctjffipl^x indicators could 
be used, the' goals of VEPS regarding the target 'group of NYC eligible, 
probable 'dropouts ^recjuired simple outcome data. • ' 

The^ existence of records and other inf otmatiqa^on *a group of regular * 
NYC enrollees suggested' the availability ,.of a . control'group-. Although this 
group was not selected in advanc^ j^becauaeJCUP^s first' grant was merely to 
monitor the first year program) , ^he' existence of NYC'records made t±e 
selection relativej^y easy; in consultation with tlj(^gepartment of Lm)or 
fear confrol 'group cities were, cho.sen: Columbus,*nint, Pittsburgh, and' 
San Pernardino. Although methodological pujrity would prefer control group' 
selectiqn at ,the commencement of- the pr9gram and lata selection, did cause 
some comparability problems (See Part II of this repdtt), the use 0f a pre- . 
test, post-test with control gpoup experimental design was none'theless 
.feasd.bl^. . . . \ 

Encouraged by the possibilities of the longitudinal study, the Center 
for Urban Programs drafted a proposal for the Department of.LaT^or* A^ a' 
result the Center received financial support under Grant Number 42-29-72-07, ^ 
The Grant w^as made, in order to enable the Center to purstie the* questions 
raised. concerning the longitudinal Impact of the 'VEPS-I program. As noted 
above,^ these questions relate ta, jthe long term, feffects of the first year 
proglram, especially with respect to basic programmatic goals. At the .time' 
of the.aw^rd it was assumed -that' the flYC Program woiild lie in operation 
during the 1973-74 school yearV':;^ . ^ ' 

Under the terms of the grant the. Center for Urban Programs was to per- 
form the following tasks: (1) litohitor the implementatijon of the VEPS-II 
prbgram and prepare a revise4"^^4wpiementation manual (§ee Youth Training 
iti thfe Private. Sector; /Model for Implementation , Juj^ 1974); (2) com- 
pare the VEBS-I,.^d VS?S-II experiences (See Vocational Exploration in' the * 
Private Sectof ; Final'&eport and Assessment, 1972-73; Comparison of Impacti 
of tKe:^ Pilot and Second Experimental Yearp , July",, 1974); and (3) determine 
the extent* to which^ the VEPS-I program attained fl.ts severaX'objectives through 
longitudinal analysis and, the utilization of ..a control group of regular NYC 
enrollees. This report, the last in the series of VEPS documentation, * deals^ 
with "this third taskT * ' ^ - * ' . . ' 



.Part II of this report sets icrth the research methodology employed 
in the longitudinal study and gives special attention to the selection of the 
control group as well as its comparability to the VEPS-I 'group,. Part. Ill of 
the report analyzes programmatic outcomes for the VEPS-I enrollees only, giv- 
ing special attention to employability patterns at s-everal cross-sections in 
time. Part* IV assesses programmatic outcoiifes in comparison tO; the control * 
group; statistical measures ■ of'^ignificance are utilized to compare differences. 
Section V contains summary observations. * A. > ' ^ ^. 
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The ,|experiehce arid kntrwledge gained from having moni toted and assessed 
both the'VEPS-I and VEPS-II programs permitted the Center for Urban Pro- 
grams to [adopt a relatively simple resBarch. design. Information' posited 
as necessary tcf specify characteristics of; enrol lees'and assess program- 
raatic-outcomes based on stated goalswas collected* as described below. 
Pertinent' enrollee demographic, family history and employment data were 
obtained from NYC-I6 intake forms and school records. Survey instruments 
or interviews were' employed where such forms were missing orvotherwise 
'fiot available, .Outcome data were deirived from interviews with ,VBPS proj- • 
ect directors tod individual counselors. For each of the enrollees records 
were obtained on academic performance, employability and general hehavior. 
Academic impact data were obtained through access . to ^the school records of 
the individual. Complete confidentiality was assured and maintained through- 
out the da£a collection and analysis. Both Employment and academic impatit 
variables were correlated ^with ^n array of demographic^ family history, 
and. work experience variables i^i order to reveal ^commonalities among vari- 
ous categorizations' of enrolleei. 

\fliile the^ results of , these, analyses left the unmistakable impression I 
^ that the VEPS experience Had significant short and me^dium term impact upon 
the enrollees, the monitoring of both VEPS-I^and VEPS-II did not permit 
answers- to^ two vital questions: ^s '' 

(1) Although short term influence can be assessed, what is the long • 
term influence of the'VEPS experience upon the enrollee in terms of aca- ^ 
demlc performance and transition into the^ full-time labor force? 

(2) Are favorable ou^omes among VEPS enrollees significantly dif- 
ferent from those^^'ctf regiuar summer an*^ *in-school NYC enVollees? Can any 
difference be attributed .to the VEPS. experience? • ^ . ^ 



A, Experimental Research Design 



' To ar^swer these questions, 'a standard pre-test, post-test with control 
grdlip e^erimental design with multiple post-test observations was adopted. 
Graphically* depicted, the research design may be presented as follows: 
* • , * 

^ ^ ' Ol X 02> 03<^4 Experimental (V£PS-I) Group ' 

O5 05 * O7 Control (Regular, NYC) Group * ^ 

in which the symbols have the following*' data and group designations: ^ 

Ol tepreserits academic performance in the 1976t71 academic, year and 
then current information on demographic profiles and family history; 
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represents the experimental VEPS year (1971,-72); 

/ / O2 represents academic perforrnance in the 1971-72 academic 'year ; em- 
Moyment status during the summer of 1972, and related data; 

/ / ' ' / ' ^ r 

, O3 represents employment activity and academic status during the 1972- 
73 ^academic (senior), year; * ' * * * 

O4 J represents final ^,19 7 ^-^7 3 academic year perfprmance, graduation/ 
dropout rates, and employability status; , - * . , ' 

pjj^'^epresents control group information comparable ''to Oj^ for the ex- 
perimental (VEPS-I) group; 



Ofi- represents comparable control ^roup information to O3; 

- O7 represents cdmparable control group information to 0^. » 

the utilization o^, this design pel)>its resplution'^of fK'e question^ 
raised above; it ^also provides longitudinal impact tracks for the VEPS-I 
enrollees concentrating on outcome variables and permits comparison to a 
control.^roup of NYC enrollees along comparable^ dimensions. The design 
is an efi^ctive control fpr the intervention and influence of exogenous 
and intervening variables (assuming comparability between experimental 
and control groups), so that^any significant differences in the academic 
performance or outcome variables may be attributed to the VEPS experience. 

B. Selection of th e Controlyroup * * 

^ \- V, • . . 

o To' impMment the analysis^ design it was necessary^ to select a control 
group of approximately comparable size and characteristics to the VEPS-I 
experimental group. Since eight programs were intensively mpnitored^dur- 
ing the VEPS-I program year and enrollee^ data for 1970-71 and 1971-72 were 
already cpllected, the selection of program sites in which to^choose con- 
-strol groups became somewhat easier. Randbmizltlpn-^ imong all enrollees in 
the eight progra'ms would have r^quirfed extensive travel and, |iven the . 
problems cited below, would haV^ been imposs^le in some cases^ The de- 
sign thus called fbr the selection of cpnti:6^%roups in only four of the' 
eight programs. \ ' . * ' 

The^ criteria originally >ugges ted to select the corltrpl group in each 
of the four* cities were multiple and complex. The following itemization 
is based on the VEPS youth^election guidelines: 

1. Control group youth had to be.-sixteen .years of age^afid rising 
^ juniors in high 'school as of September 1, 1971; 

2. They must have participated in the summer 1971 and iri-school 
' 1971-72 NYC program; > ^ .J 

3. • They should be identified as '•probable dropouts ;" 
They must been in school as. of Jtiue, 1972; '^nd 



5>^^ ^ y must not have par ticipatexi in all' or any part of the VEPS 
progtammatic experience, _ " ^ 



•who 



Youth selection in VEPS-I mandated' sixteen year old rising junior^ 
wer^ probable dropouts; thus the control 'group should havQ h^ the 
• ,same criteria for- selection. However, as »-Ha^^.rfo'ted in the VEPS7I final 
/ report,* adherence to' these 'guidelines v/as no,t unifonn^among cifcies or* 
consistent within cities. While^a larg^^ajority o^ the 'vEPS enrollees 
, met these .criteria, large numbers did not. 'Consequently, when controls 
groups. wer^ drawn, youth had to be included, w^vo" did not meet aH->the for- 
mal program criteria iti o?:der to, .'provide .compfi'ability between ti^l two ^ 
groups. ' I ' ; 

«. ' ' \ 

Related to* thife, problem was an in'suf f^iency in the size of the uni- 
verse f rom , which to select the control groups^^ especially in tho^e- cities ^ 
where seJ-ection criteria were rigorously^ Allowed. Since the VEBS pro- 
gram had mandated certain demographic characteristics for enraliees, selec- 
tion ojf VEPS youth from the poo^l of NYC enrollees reduced the ^siie of the 
universe from which to select a control group. FOr example, if Flint, 
Michigan, enrolled sixty-^two youth who met the age and academic year cri- 
teria for VEPS selection, the number of youth not selected. who met the 
program (a^nd thus conti;ol group) criteria wquld be substantially r^'duced. 

The number of subjects available, for the.'contrdl group\ was furth^f , 
reduced by the recfuirement that the youth have been in both\the svmmier . 
and in-school NYC program '^'during the VEPS experime^S^l year;\ the sharply 
reduced size of in-school NYC programs thus acted toS^duce /the pool avail- 
able for a control group. Finally, if VEPS personnel had ^^refully selec*- 
ted on,ly those youth ^ who, having met age and academic year criteria, were 
also provable dropouts, it ^ould'have been numerically and conceptually 
impossible to form a representative control group. Presumably, a number 
of youth whp were not *^probable dropouj^* would have to be selected for 
the control group, thereby inhibiting direct outcome comparisons. 

In summ'ary, the pool of eligible control group youth ayailable.do 
the research team*was considerably reduced by the fact that (],) the VEPS 
program haci consumed a substantial proportion' of the youth who met the 
selection criteria, (2) the youth had to remain in school^ during* the VEPS, 
year, and (3) the youth had to participate in both summer ^nd in-school 
NYC programs . 

Original procedures in selecting the control group were modified in 
light of the above problems. Initially, a case by case search of the 

' 1971-72 NYC records wag made, and a list of youth who met the s.election 
criteria was compiled. If the resulting list was more than five percent:* * 
belbw the required sample size, then a second li^t of youth was. cdftplj^ed 

'using the same crite^ria with the exception of in-school NYC participation, 
1% this modification also failed to .attain the requisite number of youth, 
then cases were selected who were not rj.sirig juniors. Selection of these 
Ijitter cases is .justified by the fact that VEPS programs *also included 



/ 



*Center for Uttan Programs, Vocational Exploration ln\ the Private 
" , Sector; Final~ Report and Assessment, "1971~ 72. * ' ' . ' 
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were followed in cities which had not 



youth/ 9 ther; than irising; juniors • *A11 youth who met the original s^lfec- ^ 
,tion /cri.te^^"ia were included in the sample, and a systematic random sampl'e' 
of tfte o'th'ep li&/t;($) was us^^'d ! to , draw ^ number sufficient to equal thf 
'deslJred s,ize, ^imilar procedt^res 
rigorously^' applied selectJ.o^ guidelines. 

WheViB the initial listing was withi^ five percent of the desired 
jfta, ^heu tlfie entire group jwas absorbed, ^Finally, . where" th^ initial 
>t was greater than fiv6 percent over the desired nlmijDer, a systematic 
idom sample was thien drawn* ' ^ 

^' ' I • • ( ' 

The choice of cities fri)m which fo select control groups was made ^,on 
ie basis of the -following criteria: (1) potential existence of a, Large \ 
j/nough pQol of in-school NYC enrollees so that a sample could * be ,dratm; 
[2) ready access to school records and NYC" counselors; ^3) teasonabl^e 
ja^Suran/e of the "cooperation of the VfePS ataf f *and the school dystem^ 
/especially during fo/llow-up; and (4) subjective judgments b'as^d bn indi- 
[vidual^' VEPS program designs. The four programs selected* i'or control' groups 
f are: /Columbus, Ohio; Flint, Michigan;^ Pittsburg!)., Penijsylvani.a; and Sa(n 
Bernardino, California, 



G. / Experimental/and Control Group Compatj^bilit^ 

The sampling procedures for dra\J^7:^ng .|he Control g^'oup yielded 151 
c^ses that, in/aggregate, are reasonably pmparable to the VEPS experi- 
lental group, / In order to obtain a con£r61 group bf adequate size, it , 
(iltimately proved necessary to deviate fiigm the origina^ ideal design 
and to oversample ^h/some cities to. off sejt undersamplin^ in others. Con- 
sequently, \jmen the VEPS and corftrol groups are cQitipatedT^riations can 
be found. 



n 

whether 
erable 1 
ternal Va 
as lest 




er of non-parametic statistical tests were used to determine 
ffererfces between the Vl^PS andl control groups were within tol-* 
Its, given the sampling probl,e?is 'mentl^5ed above. AithoueH in- 
idity was tested several ways,,,! the Chi\squared test was earned 
'nd most appropriate, .In certain cases, 



In certaijl cases, classes were collapsed 

" i s - 

VEPS emrollees and .the subtot 



o ensMr4 valid use' of the test. Levels] of significance in comparing the 
ontro^^ group with both the total of all] VEPS emrollees and .the subtotal 
om ^he four VEPS cities with controls !are provided in the tables below. 



/Demographic comparability between t 
le little^ difference can be noted in 

variation can be found in age, school year, and "ethnicity. The con- 
. group is somewhat younger than theJVEPS group, and understandably, 



he groups is shown in Table 1, 
tenps of enrollee sex, signifi- 



age differential is also ref lected| in school year (more underclass- 
^^nU The differential is due to two f actors ; the emphasis on sixteen 
■ ear\\olds in selecting the control group and the rejection of this cri- 
for selection in certain VEPS programs'- The combination of 'these 
plus the fact that VEPS was glared to a relatiVely.^^mall universe^ 
in highly significant distributional differences b^^eeh the VEPS 
d the control group in, terms of age. Analysis routines consequent- 
cognizance of this differential, as e. . plained .below,^,and in Part 
s report. ' ^ ^ * 
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Table 1 



SELECTED DEMOGRAPHIC CHARACTERISTICS OF VEPS-^I 
COMPLETERS AND CONTROL, GROUP 



Enrolleeii ' 
' Characteristic 



SE 



Male 
Femal&i 



15 oif yotinger 

16 y^ars 

17 bi older 

ETMJt BACKGROUND 
Bl4pk 

Spanish, Other 



SCHOOL sYEAR*^ 
Freshman 
Sophomore 
Junior ^ 
Senior - > - 



(N) 

m 

(N) 



All VEPS^I 
Completers 


. Four City, 
VEPs' 


■Control 
Group 


(272) 
51.8% 
48.2 
p> .80 


■ (155) 
56.8% 
43.2 
^jt'p> .50, . 


(151) 
53.0% 
■• 47.0 


(257) 
12.1% 
50.2 . 
37.8 
p.< .001 


; (15,2) 
12.5% 
■ , 57.9 - 
29'. 7 
p < .001 . 


(151) 
19.2%*, 
74.8 - 
• 6.0. 

* . * 


(272) 
■ 52.9% 

^8.3 ' 

18.8 ■ - 
p <.01 


(155) 
70.3% 
10.3 
> • 19.4 
P< .01 . . ' 


; (151)' '• 

69 . 5% 
2r.9 ■ 
/ 8.6 


(269i 
1.17. 
4.1 . 

68.4 

26.4 
p< .001 


(155) 
1.9% 
' 5.8 
85.2 
7.1 
P< .05 


(151) 
6.0% 
10.6 
' 71.5 
11.-9 



*IH perfqrming X"^ significance -tests, freshman and soph omoi3gZvere col- 
lapsed into a. single category. 



' dimens 



Th6 disproprotionate distribu^on along' the ethnicity dimension is 
also a function of lim^^ed universe ^ize, but more can be explained in 
terms of the geographic concentrations oif youth with. S^anisji ^surnames . 
D^ie to tiiiese area concentrations (especially San Bemardinc/) direct 
iiorrespondence between the groups was impossiBle. Since ^no meaningful » 
ethnic related differences are suggested, thlj^ factor is not important 
to the assessment of progtam outcomes^ Thu6, while important distribu- 
tional variation tan be lioted, those differences aris0 from uncontrolled 
factors (program guidelines, decisions of VEPS staff, anii^^Uimited uni- 
verse) rather than procedural aspects of control group^ selection. ' 

^ Gre)^ter comparability,* at least given the lo^^' statistical signifi- * 
"cance of 'th;e frequency distributions, exists teti^een the experimental and 
control^, grdxi^ with regard to ^family characteristicaj. See Table 2. Given 
.conventiona^l interpretation oX the Chi squared statistic, none of the 
variations 4>P^oach statistic^ importance Cp<*05), except for jthe public 
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' ^ Table 2 

*SELECTED*FMILY; CHARACTERISTICS OF VEPS-I 
• ^ COMPLETERS* AND CONTROL GROUP % ^ 



\. Family ^ 
Characteristic 



>11{VEPS-I ^ 
Completers 



Four^ City 
VgPS 



Control 
Group 



HEAD OF 'HOUSEHOLD 
Father 
Mother 
Other 



employmeiJt of head 

Over 35 hours 
Under 35 h'ours 
Unemployed 



CONTRIBUTESVTO 
FAMILY SUPPORT 
' Yes- 
No 



(N) 



1 



PUBLIC ASSISTANCE 
Yes 

No •" 



(N) 



. (270) 
*35.9% 
56.3 
7.8 

'p<: .30 

(262) 
30.5% 
16.4, 
.- 534 
■p< .50 



(155) 
. 32 . 3% 

61.3 
6.4 
p< .20 

(155) 
18.>% 
15.8 
' 65. ff"' ■ 
p< .10 



(151) 
44-0% 
.49.3 
6.7 



(150) 
30.2% 

5€.4" . 



(N) , 

1 

I 

\ 


' ; 

(221) • 
28.1% 
71.9 
P < ,10 


9 

(132) 
12.1% ■ 
87.9 
.P<.30.^ 


(134)' 

' 19.47 
. 80.6 


(N)/ 


■ (267) 
50.2% 
49^8 
P< .99 ^ 


(153) • 
64.1% . ■ 
35.9 
p<.05 , . 


(151) 
•. 51.0% 
,• 49.0 



^assistance variable comparing the control group with the sarte'four VEPS 
cities.. Such bias as d6es^ exist* casts the control group in a favored 
light. 'Generally, tlie , control group evidences, fewer characteristics of 
social patholcJ^yVfem^e headed households, unemployed or underemployed 
head of household, and public assistance — than do .the VEPS enrollees. It 
is not lanreasonabl^ to argue \hat youth experiencing* fewer of the debili- 
tating, effects occasioned by social pathological f ac^tors would experience 
less difficulty in attaining satisfactory academic performance and^'moving 
into the full-time labor force. Thus, although small levels of bias do 
exist between the control group and the VEPS' group^ t|at bias ^ constitutes 
a more vigorous test oi^ the VEPS program— if VEPS can- be 'shown to have' ai^;^^ ^' ' 
impact upon enrollees. ^ ;^ 

The VEPS experimental group and the control group are algo comparable 
in term^ of their t>rior work experience. As can be.feeen in Table 3, sub- 
stantially equal proportions of yoiith had held a job for which they re-/^ 
ceived wages and had worked, for thirty da^s or more. For most of the youth, 
this work experience was obtained^ through the regular NYC program. ^ 

Finally, since academic perfdraance constitutes ^pne of the criteria 
by whi,ch the impact of the VEPS program is to be assessed, some measures 
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Table 3' 



SELECTED EMPLOYMENT HISTORY CHARACTERISTICS OF 
VEPS-I COMPLETERS AND CONTROL GROUP 



Employment 
- History 



All, VEPS-I 
Completers 



Four City 
VEPS 



Control 
.Group 



EVER WORKED 
Yes 
No 



WORKED 30 DAYS 
Yes 

No ^. ^ 
Never Worked 



(253) 
61.7% * 

38.3 ' 
P < .80 

(248) - 
53. 6r-^ 
7.3 * 
39.1 ' 
P < ".'50 



(136) 
65.4% 
34.6 
P < .'50 

(135) 
^8.5% 

. 6.7 
34.8 > 

P < .20' 



(151) 
-62. 7% 
37.3 



, (151)- 
57.8% 
• 4. •4 . 
37»^ 



df comparability must be defeermined f o^,beginning (1970r71) grade paint 
aver^ge6 and attendance in school. F^r' lieasons dited bfelow (chiefly the ' 
rational character of the data), t-tests were cci^py^ed comparing -both grade 
point average and attendance for both groups in" tfie.. 19 70-71 school year, 
(the year^ preceding the VEPS, ^xperiment)^ See table* 4. No significant^ 
difference could be found in grade point averagfes . i/ith attendance, the 



Table 4 ^\ 

T S'C0RE5 AND SIGNIFICANCE^ LEVELS OF ACADEMIC^ INDICATOR 
COMPARABILITY BETWEEN , VEPS COMPLETERS AND -.C^TROL GROUP 





Six city VEPS/ 
Control 


Four Cdty VEPS/ 
Control 


1970-71 Grade Point Average 


'-0,2233 , 


-1.4993 


1970-71 Attendance . 


^ 2-8^17**^ ^ - 


3'. 5263* 

f 


• . ^Significant at the ,001 level 
^^Significant at the ,01 level 
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distributions were found to 'be significant ^t the ,001 l^vel, biased in 
favor of the ^control- group * In oth^^words, the. control group showed 
significantly greater attendance and the VEPS gr.oup .greater absence in 
the year preceding the experiment As with family characteris-tic data, 
the importance of this distribution is that it provides a more rigorous " 
test of the VEPS program since ,to reduce the significance level would re- 
quire substantial improvement among tlie VEPS enrollees* 



D^. Data Processing .and Statistical Routines ' * ' . 

The data for analysis' were collected by CUP monitoring" teams over the 
duration of the VEPS ' ji^ogram, usually, within two months of .each terminal o . 
poiAt within the time series. Academic indicator inf o^hnation was' detived. 
from initerviews with VEPS directors and counselors as well as the youth 
themselves. These data were classified and coded by Cl/P staff; dat<a con- 
sistency and clean-up were introduced at three points- in tha^analysis <, ^ 
process,* thereby reducing possibility of coding error to' a minimum, "^T^^ - • 
some cases, data on individual cases are missing despite the efforts 'o,f 
CUP and VEPS staff. |rhis pertains primarily tb tracking the^yotitli fdllpw- 
ing graduation when contact with VEPS*altd the 'School tended to *dissi^ate 
rapidly. Data were processed o.n the CDC 3300 hardware at the Yalem Com-' 
puter Center , of -^Sajnt Louis' University using both canned and special pro- 
• grams. ^- ' 

To draw meaningful comparisons between samples of uneven size, appro- 
.pfiate "weights must b^ given to each sample in order to cohj^i the rela- ^ 
tive '^influence of each standard deviation in terms '6t simpl^^ize. Such 
a procedure is particularly useful in a pre-test, post-Wwredesign. An 
appropriate statistical routine to handle the rational character of the : ^ ^ 
various academic data sets a$ well as the 'disparate siz^ cJf^'the two ^grpups 
is the t-test. This, routine is capable of handling -sample size distort 
tipns and yields -a tes.t -of signifiWice. Iix'.order to justify the t-tdst 
in this situation, it^ is necessary tb assume that (1) the po^ul^ions s . 
sampled have normal distributions and (2) the population variance^ (i^tandr 
ard devia'tfSns) have the satne value. Although these formal reqViifements 
are frequ^tly insisted upon, slight violations of the requirements^ have 
relatively small effect up(ui conclusions. A normal diatribution is^ apparfenr- 
ly the less important of the two. Therefore, to test whether both groups 
have relatively the same^ variances, the F-test was employed. Iwhere. F ratios 
proved variance to (Siff^r excessively*, the t-teslT was then ignored,. As ■ ' 
. will be noted in Part IV of /this report, rejection of t, values ^as f6rced 
only IiTcomparisons within individual cities. Although a significance '\ 
level of -.10 would be accepted for t^ie one tall alternative by most ana- 
lysts, we -utilize the more rigorous -.05 level to compensate f or shortcom-: ^ 
ings in the data.* ^ 

- , A' - ' 

While the rational, data (acad^ie^ inxlicators) are susceptible to the 
t-test, the nominal data on ^rogr^m,. outcom^precludes the use^'f this . 
routine. Outcomes are*measured in terms of graduation rates and uj-timate 
employabiXity on a full-time ba^sis. To test th'e significance of tfieS^*^ 
outcomes, we^pelied on the Chi square s'tatistic. As above, iJfe accepted 
findings as significant only at the .05 leveK ^ ^ ' c , 

The results of the statistical analysis '^and interpretation to asse^:s ^ 
the long^ and short term influence of VEPS canibe found in Part iV,. 
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PART III 



ASSESSMENT OF LONGITUDINAL IMPACT ON VEPS-I. COMPLETERS 

9 \^ 



The VEPS-I program enrolled 431 youth in eight cities—Columbus, Ohio 
(49); Flinty. Michigan (62); 'Fort Worth, Texas (48); Haverhill (20) and'^Eaw^ 
rence (33>) , ' Massachusetts ; Pittsburgh, Pennsylvania <60) ; 'Salt .Lake City, 
Utah (99^; and 'San Bernardino, California (60y. Although Norfolk, Virginia, 
also condupted a' VEPS-I program, no syst^tnatic data were available on en- 
rollees.in* that ^it'y. No 'follow-up data are available fo.r Lawrence.-and 
Haverhill. . 'AlinoSt tWo-thirds (63.1%, h = g^7;2) : completed the y^ar long pro-' 
gram. .Of the completers sixty-nine (25 .4%)* were seniors who graduated. 
The 159 terminations (36/9%) included forty- two high school dropouts^ (9 . 1% 
of tlie original group ^of enjrollees and 26,4% o^ thp terminations)'. The 
descriptive analysis which follQifs concentrate3 on 'the VEPS-I completers 
for the summer following the experimental yearL their senior year in high 
school, and the ^three-month period following graduation of their class. 
Additibnal information on the experimental year outcomes may be found in 
Center for Urban Programs, Vocational Exploration in the Private Sector: ^ 
Final Report and Assessment, 19 71-72 > For a comparison~of the VEPS-I and 
VEPS-II programmatic outcomes, see Center for Urban Programs, Vocational ' 
Exploration in the Private Sector: Final Report- and Assessment; 1972-73 ;- 
selected comparative demographic and outcome data for the two program years • 
are rep/^rted in the' Appendix. ' ^ ^ * * , 



'Four separate ^data sets .are utilized in this section — academic per- * 
formance (grade point average and attendance) in the senior ye^r, final 
high school academic disf>osition, employment patterns following the VEPS-I 
experiment, and employment patterns following .commencement of the high 
school class. Statistical assessment of the significance of these' longi- 
tudinal patterns in comparison to a control group of ,NYC enrollees is pro- 
vided in Part IV- of this report. • ^ - " 

A. Academic Performance of the VEPS-I Completers . - * 

Amon'g the several program obj'eQtlves was a desire' to enhance enrollee 
awareness of the need for, and value of, a high school education* Twa in- 
dicators of program impact w^re available to assess the degree of program ' 
success — grade point performance (G.P.A. ) and attendance. Table 5 provides 
a. comparison of change in academic indicators for the VEPS-I experimental 
year and the senior year following; The data 'base fipr the VEPS-I yeax was 
the year prejceding (1970-1971);' the data base fqr the senior year i^ the 
VEPS-I yeai; (1971-1972). Data for th6 senior year (1972.-73) presumably^ / 
demonstrate the staying- power o^ the VEPS-I impact, thSt is the degree**.to-*'- - 
which the VEBS^ experience continuefd to manifest itself in improving oTTSu^ 
stabilizing grade point performance and attendance in school during the, 
senior ^yeaj^ ' • ■ r ^ * 

In terms of grade point average, the aggregate data reveal quite simijjl^^ 
Ijar impacts. Although in terms pi totals, slightly mo|jQ^ youth declined 
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Table 5 

Comparison of Change in Academic Indicators fdr /the VEPS-I , 
and Senior Years for VEPS-I Cpmpleter^ 



Academic Indicator 



VEPS-1 


Senior 


Year/- 


Year 


\ j 




(148) 


6i..k ■ ' 


^ ■ 56.8% 


2.8 


2. "7 


■35 M 


40.5 




100.0% 


(254)^ • 


,(148) 




6.1% 


12.2 


.12.2 


26.8 


28.4' 


28.3 


31.8 


13.4 


• 15.5 


7.5 


^ 3.4 


2.8 


■ 2.7 


100. U' 


.100.1% 



Grade Point Average Change 
- Up • * 
^ Same 
Down 



Summary Scale, G. P. A. Change 
+1.26 or fefctter- - 
+0.76' to +1.25 ■ ' 
+0.26 to +0.75 
-0.25 to +0.25 
i -0.26 to -0.75 
to -1.25 " 



-0.76 

-1.26 or worse 




Attendance Change 






(N) 


<245) 


Up* 


49.8% 


Same 




4,. 9 


Down 




45.3 






' 4:00.0% 


Summary Scale Attendance Change 


(N) 


(A45) 


+10 days or more 


i 


26.5% 


+4 to +9 days f ^ 


A • ° 


13.5 


-3 to ^3 days 




22*0 


-4 ^ to -9 dayg 




.134 


--10 days or more ^ 


• 


24.9 






100.0% 



(129) 
48.8%- 

3.2 
48.0 > 
1(30.0% 

a29) 
24.8% 
17.8 
21.7 
14.0 ^ 
21.7 
100.0% 
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in grade point average duris*/t;he senior year, when these data are scaled 
it can be se^n^that a substantj.al portion of those declities were quite 
small in magnJ(tude, While 48t1% 9f the ^outh improved by' at leasts a quar- 
ter of a grade poiht in tha VEPS year, 46*7% did so in" the senior year. 
Looking at the opposite end of the scale, 23,6% of the youth declined by 
a^iquar^^ar ^oint of more during the VEPS year compared to only 21^6% dur- 
i^g Vhevsenior year, * 

I * ' ' , . ' ' ^ 

• 'The same .pattern holds true for 'the attendance data. While slightly 
mo^ youth declined absolutely in attemiance during the senior year (i,e,, 
mila'ed more school), the. magnitude^ of that decline is quite small. In th^ 
VEPS year, 38,0% of th'^ you^h declined in attendance by four ^days.or more, 
compared to 35,7%. during the senior year, ' ^ ' - > 

/' These 4ata'" would indicate a moderately strong long term impact due 
to ' the VEPS ejKpe^rience and ^supports the contusion that.VEPS has a bene- 
fi/cial impact upon, the enrpllees in terms j^Pfrade point average and sctool 
attendance. This conclusion can.be tested further by examining chaftge n 
academic and att'^ndance performance over the two year period covering both' 
VEPS and the following senior year. These data are provided in Table 6, 



Trend: 



table 6 

Academic Indicator Trends: VEPS to Senior Year 
VEPS to Senior Year 



r 



G,P,A, 


Attendance ' 


Trend 


Trend 


: b 

(1^) ' 


(126) 


16.9% 


■ 17.5% . 


, 1A.2 


' 9.5 


22.3 


" ' 15.-9 


10.1 


5.6 ^ 


9.5 ' - 


5.6 • 


'3.4 


■ ? 11.9 


15.5 


. , 20.6 


6.8 


4.8 


. 1.4 


■ 8.7 


. 100 . 1% 


^100. U 



(N) 



Improved- VEPS 
Improved VEPS 
Improved VEPS 
Stable, VEPS; 
Stable VEPS; 
Stable VEPS; 
Declined VEPS 
Declined VEPS 
Declined vSpS 



; improved 'senior year 
; stable senior year 
; declined senior year- 
improved senior year 
stable senior year 
declined senior y^ar 
improved senior^ year 
stable senior year 
declined senior year 



In terms of grade point average, long term positive impact (improved at 
lea§t one-quarter grade point) is apparent in 31,1% oJ^ the youth ^ (improved 
VEPS^ and improved or stable senior years), and only 8,2% experienced long 
term negative impact (declined at least one-quartej: point in VEPS and w^re 
stable or declined at least one-quarter point in the senior year),* Short 
term positive impact can be seen in, 22,3% of the cases (improved in VEPS 
but declined in senior year) compared to 15,5% short term negative impact 
(declined in VEPS but* improved in senior year). Of those who improved 
academicsflly in their senior year grade point average, two-thirds improved 
or were stable in the VEPS year; of those who demonstrated a stable senior 
year, over three quarters impi^oved or were stable in the VEPS year. Finally, 




of those who declined Iri their senior ye^r/ 94»8% improved or were stable 
in their VEPS^year. These several sfilits^o'f the data confirm 'that VEPS 
Had long term favorable impact for nearly (5ne-ty,rd of the enrollees. andu 
short term favourable impact for anot^^^ 6xie^j^\iartSt\' compared to a com- 
bined long and ^hort term" negative impact on^out one-sixth qf -the en- 
rollees. On' balance, the VEPS experiment musx be termed sutcess'ful in. ^ 
terms of improving academic performance. ' 

Data for patterns in attendance are not as dramatic, although still 
clearly positive in outcomes** Long terra benef itSv can^be seen for 27»0%' * 
of the enrollees compared to long term negative impact ior 8»7X; short '^ 
term positive impact occurred in 15 ^9% of the cases . cdjjm^ped to short terra 
negative in 4»8%. Of, those who improved in thei^ s^ndP^^ear, over ftalf 
152.9%) had improved or were stable in the VEPS yeal:,_x*hJee-f oqrths .of ^ 
'those who were stabl^ in their, senior year attendance had imp*roveci or w6re 
stable in the VEPS }^ear^, while a similar three-fayrths of those who dfiicl;ined 
^in the senior year had improved or"lJei?€ stable in the VEPS year, .These\^^ 
^data ^zeinforce the conclusion tHart the ne* effect of VEPS uppn enrollee 

attendance ih school is^ clearly positive, ' 

- • . ... . • . 

As favorable as th^se trend data are in assessing'^ the ii^pact of , VEPS 
upon enfo'll'ee school performance, the enrollees. who expetieaced declines 
in their senior year nSy^w^ll mask an overall positive impact for VEPS, 
especially, those wjio decil'^^gfid in their senior but whose performance through 
and follow4.ng VEPS was substantially better than their performance in the 
year preceding the program, year , Thus, coinpos^tte three year trend d^ta 
are required to measure more precisely ^e actual impact of VEPS j 
data are" presented in^Table 7, 

* 

Table 

/ " ■ - . ■ « 

♦Composite Three Year Academic Indicator^ Trends 



Composite Three Year Trend ' 




G.P.A. 


Attendance 


(1970-71 to 1972-73) 




Trend 


« * , Trend 






« 


_ ^ . _ . - 






• (148) . 


^ "a26) 


Steady improvement 




35.1% 


27.0% 


Improved VEPS; stable senior 


2.0 


.4.0 


Improved VEPS; declined- senior. 


but ^ J 


17*. 6 


, 12.7 •. 


improved over base 




t 




Improved VEPS; declined senior; 


below base 


13.5' 


12.7 


Declined VEPS ; improved senior; 


over base 


15.5 


13.5 


Ifeclined VEPS; imp^roved senior; 


below- base 


■6.8 ' 


9.5 ' 


Declined VEPS; stable senior 
^Steady decline* 




0.0 


> 0.0 




3.5 


20.6 






100.0^ 


100.0% 



- X 
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ot\i short and long ^erm positive Impacts upon enrollees can be disqemed 
for the^three year .period.:^ In tertns of grade point perf ormance,. a t^tal 
of 70.2% improved their senior grade poiiit. average over- the base period, 
regardless of ou^me during the VEPS year,^ this figi^re includes 35.1% who 
show steady improvement and anothef 2/0% »who improved in VEPS and stabilized 
in the senior yea^. A* total of 29.8% declined below the base figure with 
9.5% .showin^^steady decline over the three^'year period and another. 6.8% 
who improve (™?r VEPS in the senior year but 'were ^ till below the base 
figure. • ^ * . * 

In terms of attendance^ once again the figures are favorably but some- 
"^hat less dramatic than gVade point average^. A tot^i of 57.2% itnproved 
attendance over the base period, including 27.0% who steadily improved and 
4.0^ whcr-improved and then stabilized. On the opposite side, 42.8% showed 
a decline below base figures, including J^O. 6% who steadily declined and 
9.5% who improved over VEPS* in th^ir senior year but still ,had more absences 
than during the base period. • ^ ^ 

Overall, then, the three year trend, data are quite clear. The VEPS 
experiment had a beneficial imp^'act on a substantial majority of the VEPS 
enrollees; while some negative impact.can be observed, both the short and * 
the long term impact is obviously positive, indicative of substantial and 
e^nduring impact upoi) the enrollees. The: 'program objectives of enhancing 
enrollee appreciation of the need for and benefits of a'high .school educa- 
tion appear to^ have been met. Left .unanswered (teinporariiy ^ see Part IV) 
is the question whether the improvement shown is common to youth similarly 
. positioned or whether the outcomes can 'be" attributed to VEPS. 

B. Final Academl'c Disposition * ^ 

A second major objective of the VEPS-I experiment was to encourage ,^ 
youth to remain in school and to graduate. The indicator of programmatic ' 
success or failure in this regard is relatively easy to operationalize*, 
ana the data in Table 8 clearly demonstrate that to a substantial extent 
this i)rogram. objective* was met. ■ ^. ' * ^ ^ 



Table, 

Final Academic Disposition for VEPS-I Completers as of June, 19 73 

Disposition ^ (Percent) 

Graduated, 1972- _ 69 

Giraduated, 1973 * 134" 

Not graduated,' could have . . , 9 

Not graduated,' could not hav^ ^ ' . 13 

Dropout * * , . * • 22 

Total 247 
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*Previously, change had been measured'' in 'terms of + or - a,quarte/ of 
a "grade point; any change ttf less than a quarter point was con si^6>erfs table 
Data in Table 3 ara' pres<ented» to show any change whatsoever, regardless*^! 
magnitude. » « " . " * , '1 , 

O * = . * -19- ^' - ' ^ \ 



Of the 247 VEPS completers for whom data could, be obtained, 203 (82.2%)^ 
graduated from high school.' Although VEPS guideline^ called for ^he^ selec- 
tion of rising' juniors seveTa±vjm)grams included a small number of ris- 
' ing seniors and sophomores among the enrollees; these are reprresented by". 
the sixty-nine seniors who graduatedVin 1972 (close ofJffiPS-I) and thir- 
teen youth (predominantly sophomores) who were *incapa(6le of graduating 
in 1973 « A more accurate representation, then, wqj^ have a total of 134 
youth out of 165 (81.2%) who were rising juniors at" the 'time of enroll^ 
ment in VEPS. who continue^in school and graduated on sch^ule. Nine 
youth (3.6%) who could have gratiuated failed to do so, while another twenty 
two (8.9%) dropped out i^ their 'senior year. Males predominate among the 
dropouts; the reasons most frequently given Were finding full-time employ- 
ment and entering military service. 

- ■■ a 

As with the grade point averatges and attendance data, the jEinal 
academic disposition of the VEPS-I completers provides another indicator 
of successful attainment^ of programmatic goals. 

C. Employment Patterns' Following the VEPS Experience 

A major objective gf the .VEPS program was to provide NYC eligible 
youth with work exprerience and job training so as to permit them to ob- 
tain full-time private sector employment in the summer between the end 
of^the VEPS experience and the start of their senior year and part-time 
through the senior year. The data in^Table 9 provide frequency distri- 
butions by employment status for three time references: at the close of 
Nthe VEPS experience, for the summer of 1972, and throtagh the senior year 
ot school.' .s ^ ' 



Table 9 

Employment Status of VEPS-I Completers at Selected Time References 

^ ^ Clos6 pf Summer School Year 

Employment Status VEPS-I . ^1972 (Senior) 1972-73 

(N) (258) (177)** ^ \ (177) 

At VEPS employarr ' 37.2% . ^ ^3.7% 

Other private sector 4.3 "^.4 - 4.0 

VEPS'-II * 22.9 40.7- . 33.3 

NYC, other public sector 20.9 20;3 18.1 

Employed private sector, . N/A 0.6 ,5.6 

later terminated . * 

Unemployed in school * 4.3 1.7 1,1 

Dropout ' ' N/A 2.8 12.4 * 

.Other ' * . * ' 10.4* * 1.1 1.7; 

.Unknown N/A 0.0 0.0 . 

^ 100.0% 100.0% 99.9% 



*Includes, 5.2% In higher education and 2.3% military service. 
t **L'ower"S is due to exclusion of VEPS seniors who graduated at the 
^end of the ptogjf^ year and absence of data from several cities. 



The data are complicated by a series of events that marked the opera- 
tions o^ the VEPS-I Program. Many programs began the projected year long 
program later than scheduled, and consequently,- felt it "desirable to re-^ 

* enroll youth in *VEPS-II for a second year of work experience and train- 
ing; other p^^grams failed to convey the goal of unsupported private sector 
employment for the youth after the first year to the employers. Conse- 7 
quently, when-the employer was asked to .retain the youth, many refused, A 
small group of employers, who had been- made awarfe of the program gosl/ toph 
advantage of it by later refusing employmeht. In both these cases, youth 
tended to be reassigned to VEPS oi; the regular NYC program dur:^n&^ the 
summer and/or, senior year. These events handicapped many programs ,and 
seriously limited effective asses*sment of the. intermediate employment goals 
of the VEPS program,' the impact of operational problems is <:learly demon- 
strated in the data; 43,8% of the yo^h were re-enrolled in VEPS-II or 
placed in NYC at the close of the e^perllgYtal year; in the summer this 
figure rose to 6]/,0% but , fell slightly during the senior year to .51.4%. 
Such heavy concentrations of youth in the VEPS-II and NYC categdries in- 
hibits meaningful analysis; and clouds iaterpretation of other data. How-, 
ever, a sizable number of youth did remain at the VEPS employer^ gradually 
declining over the time references provided, A smair>ercentage of youth 

•found other private sector work,, but fpr one reason or another ^terminated 
that employment. Extremely small percentages were unemployed at the various 
measurement points. Other private sector employment remained fairly 'stable 
over the time period; when these youths are combined with the youth re- 
tained by VEPS employers, a sizable proportion of youth wer^ placed in - 
the private sector with some prospects, of longevity, ^-Qn^* -suspects, there- 

^fore, that the VEPS program partially attained the \j>^ective of private.^ 

-sector employment, but the data are imprecise du§^^ the VEPS re-ehroll- 
ments and NYC assignments*! , ' • ^ ' \ 

D, Final Employment Disposition • ' ^ 

The ultimate go'a^ of the VEPS objective. was to provide work experience 
and training for fuli^time employment upon graduation from high school 
and* thus ease trarf^tloA into the labor force. The ultimate' test of effi- 
cacy rests in the extent to which any o^ several programmatic putaomes aiei^- 
consistent with the pl;c)gram objective, full-rtime employment and higher ed- 
ucation being two of .the more ^obvious favorable outcomes. The data in 
Table 10 demonstrate the* ef fectivenss of VEPS in attaitling the ultimate . 
prorgrammatic objective. 



Table* 10 



Employ^eat Status of VEPS Completers Foil 



owing Graduation 



Employment Status 



N 



At VEPS employer 
VEPS skill related employer 
Unrelated' private sector 
PubldQ sector emplo3anent 
Higher o\ technical education 
Military service / . . ^ 
Married, housewife 
Unemployed 
Other (moved) , 



59 
'15 
32 

3 
48 
14 
13 
22. 

5 

211 



28.0% 
7.1 

15.2 
1,4- 

22,7 
6.6 
6.2 

10.4- 
2.4 



100.0% 



Private sector employment on a full-tiVe basis accaounts for>»slightly more 
than half (5,0 • 3%) of those enrolled that could be tracked. Although 10.4% 
of the youth were unemployed following graduation, this figure would appear 
to be substantially belbw the' unemployment i:^tes for teenagers generally 
,and black teenagers particularly. — \ 

» 

The data on employment status provide a reasonably clear picture" 
of the impact of VEPS . Favorable outcomes (excluding the unemployed and 
the "other" categories) total B7.2% of the youth who completed the program. 
Public and private, full-time employment accounts for 5l.7% of tfie VEPS 
completers; a plurality (28.0%) of youtfh remained at the VEPS work Sta- 
tion and an additional 7.1% found work at another employer utilizing skills 
and experience obtained atTthe VEPS employer. The » data implications are 
clear: >the VEPS program, based on these disposition outcomes, appears to 
be a significant and me^nin^ful instrument for encouraging youth to remain 
in school, gain work experience, graduate from high school and find full- 
time employment. 
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PART . IV 

' COMPARISON* OF VEPS' COMPLETER AND CONTROL GROUP OUTCOMES ' 

To determine whether the generally favorable VEPS' progranun^tic out- 
comes reported in the previous section '*were liue to the pr^gra^n. or tp inter- ^ 
vening variables (such as natural maturation or localized ecoixomic or ed- 
ucational situations), 4 -control group of regular NYC enrollees . was drawn 
in four of the eight cities operating a VEPS-I program;^ these' cities were: ' . 
Columbus^- Ohia; Flint,' Michigan; Pittsburgh, Pennsylvaiftaf and Saiv,B6mafdino, 
Californiay^ The control group selection pro^cess is detailed. In Paf^ II o^ 
this vepovL total of 151 NYC youth was sheeted for ehe^cftitrol group,^ 
compared ^o 155 VEPS-I completers in the same foiXr cities/ The Walysis ^ 
may Vary with iridividual variables and correlations dtie to missi*ng data^ 

Comparison of .outcomes focuses upon three 'data sets: (1) academic 
iridlcators as ^measured by change in gra^e point average and attendance pat- 
terns; (2)'-the graduation and dropout urates; and (3) employ ability oiE the 
youth upon graduation. Where rational data are involved (grade point average 
?jid attendance), T-scores were deemed an appropriate statistical measure of 
significance; with notalnal data (graduation rates and employability) , Chi 
square was utilized. For each of the data se.ts, some discussion of pro-. 
^ gramma tic outcomes is provided for individual cities • By 'examining the 
n'uances of the data within specific programs, the impact of those nuances 
upon aggregate^ impact measures can be appreciated. Also, discussion of out- 
comes in individual cities provides s"ome orientation, to the reader in inter- 
preting statistical pTesei>tations, Finally, such analysis permits the read- 
er to assess levels of success within individual cities,, and, by using prior 
reports, td compare their-t>wn situation and work experience program^ to those 
in the VEPS-I cities. Due to small, ceils, statistical significance tests were 
not computed^ for all cities for all variables,^ 

A, Comparison^ of Academic Perfbrmarfce and Attendance Patterns ^ 

The' t-scores provided in Table 11 compare grade point averages and 
attendance patterns jfor the two groups in each of the four cities by year 
'and by^ change between years. Given the guidelines for selecting VEPS en- '[ 
rollees we would expect the t-scores for the' 1970-71 ischobl year to indi- 
cate a bias against the VEPS-I group, that is, the scores would indicate 
that the VEPS youth were lower in grade point performance (in<iicated by a 
negative sign) ' and higher in absences (indicated by a positive 'sign) , The'' 
asterisks next* to each t-score indicate levels of significance. We would 
further expect,, that, if the VEPS program occasioned change among the enrollees 
in the 1971-72 experimental year, the intensity of Jthe t-score bi^s against 
the VEPS-1 .group would diminish or reverse to the point that there wduld 
be little difference between the two groups (non-significant t-scores)*. 
We would further expect th^t the. **no significant difference" pattern would i 
hold constant in 1972-73, indicativfi of a long range positive impact for 
the program, • ^ ^ * - 



In terras of change, our expectations are similar. Change from 1970-71 
through 1971-72 should reveal significant imprpvement among the VEPS yputh; 
the durability of that change (at a lower level of or no significance be- 
cause much of the gap would have been eliminated between the two groups) 
should l>e reye^ied*iri change from 197>-72 through 1972-73, Finally we would 
expect to find significant differences in terms of change over thei period 
1970-71 through 1972-73* In light of previous analysis , w% woyld expect , 
change in grade pointy performance to be at a higher level of significance . 
than .change. in attendance patterns. 

As can be seen in Table. 11, the expectations regarding the impact of 
VEPS are generally confirmed when enrollee data are compared to that of 
the control group. In teruis of grade point average th^ difference^ between 
the VEPS-I and flie control groups is in the expected direction (nefeatiye) 
f or ^tne 1970-71 base year with the exception of San Bernardino. Succinctly 
interpreted, the data reveal that the VEPS-I group in three of the four 
cities (significantly in Flint and Pittsburgh) was initially inferior to 
the control group in academic performance. In San Bernardino, the VEPS-I 
group was superior, but the difference is not statistically significant. 
We find also that the\dif ference between ^the groups narrows considerably 
for the experimental year (1971-72) in the expected direction, again with'' 
fhe exception of San Bernardinot Finally, for the 1972-73 senior year- the 
t-scores reveal that virtually »o difference exists between the tVo^ groups. 
This -is indicative that in each city, the impact of the program was to 
stabilize and equalize grade point |)erf ormances between the VEPS and^on- • 
trol groups. This is ^ positive outcome for the programs in ColumbSs,' 
Flint and Pittsburgh (particularly the latter twa) an d^i- negative outcome^ 
for San Bernardino. It ^should be emphasized that the-HButcome in San 
Bernardino, whi^le negative,, is not statistically 'significant ; the data mere] 
reflect the influence of the creaming that occurred in. the seJect:J.on of 
enrollees for VEPS in that city. Pittsburgh, definitely recruited youth with 
/'hard core" Academic problems, so- that any change could only mean an improve 
ment in that city. 

Considering the change data, once again the expected distributions 
occur with the exception of -San Bernardino. The impact of VEPS during the 
experimental year results in significant change in Flint and Pittsburgh; 
in Columbus the change is incremental and maximizes duri^pg the senipr year. 
Overall, change from perfprmappe in 1970-71 to performance in 1972-73 is 
significant 'in Columbus (.05 level), Flint (.02 'level) and Pittsb<5rgh (.01 
level). In San Bernardino ghange Is in the neg^itive direction, although 
the amount of change is not statistically 'significant . , 

* In summary then, th*e "conclusion that the^VEPS program had a positive 
and significant impact upon grade point performance for the VEPS enrollees , 
is confirmed in three cities — Columbus, Flint and Pittsburgh; In 'San Bernar- 
dino (which had been somewhat "s.eleetive in its VEPS recruiting), change is 
'in the negative direction and reflects .the creaming process^ but is not^ 
statistically* significant. ' m 

The t-scores for the attendance' data are also in the, expected direc- 
tlion*, For the 1970-71 base year, the VEPS-I completers w^e absent, to a 
greatef degree than the control group (indicated .jy the positive sign pre- 
ceding the t-scores).* Impact ,ove^ the long .term is Significant only dn 
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Table 11 . ■ 


■ 


\ 




Within City T-Scoi:e -Comparisons of VEPS and Control Groups -fpr Academic Indicators \ 

By Year and. By Change Over Time/ i . ^ \ 

;. ^ . ■ . ' ' ■ i . V \ 




Academic Indicator 




Columbus 


Flint - 


Pittsburgh 


San Bernardino 


\ , 


Grad^ Point Average ' 

1970- 71 . . 

1971- 72 
■ . 1972-73 




V 

-1.2389 
0.0141 
0.2107 


■ -1.9150* 
^ 0.2745 ' 
0,6009 


-3.7759**** , 
1.7175* 
;■ -0.0438 ■ 


,3.6206 , 
2.5699 
'0.7207 


\ * 


Change in G.P.A. 

1970- 71/71-72 

1971- 72/72-73' 
1970-71/72-73 




1.2480 
M 2.0764** 
' 1.7472* 


■ ' 2.0190** 
0.7040 
2.2050**" 


6.1238**** 
-1.6157 
2.6435*** 


-1.3100 
-0.860^ " 
-2.6529 




Attendance^ 

1970- 71 

1971- 72 
^ * 1972-73 




0.2426 
-1.6468 
.3666 


1.377 
-0.2201 
2:30^8 . 


- 3.5418****- 
• . \ 0.3896 

.-0.5491' ' • 


' 3.3898 
,;• 3.8420 
0.7603 


m 
1 

V 


(?hange in Attendance 

1970- 71/71-72 

1971- 72/72-73 
1970-71/72-73 


S 


-2.9886 
0.1480 
■ -1.4967 


. -1.3465 
2.2664 
0.4693 


-3.3173****' ' ■ 

-0.0082". 

-1.9054* 


-0.9060 
-2.9386 
^ -2.2582 


r 


Synibols.'' 

* = significant at the ;05 level, 
** = significant at the .02 level 
*** « significant at the .01 level 
= significant at the .001 level 
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Pittsl)urgh, although The^ scores re^(eal improvement among VEPS enroilee^ iiti^ > 
the remaining cities, but not at a statistically significant level. Unlike 
^ grade point performance, the impact of VEPS upon schogL attendance is not 
dramatic within individual cities; this conclusion,, however , is consistent 
with previous observations that attendance and grade, point performance do 
not appear 'to be related in a statistically significant manner, and on. 
occasion have been found to be inversely related. As was Found in the d^ta ^ 
on grade, point performance, San Bernardino ;:uns contrary to the trend in 
the other cities, although again the change is not statistically significant. 

The highly visible impact of VEPS in Pittsburgh, assuming all other" 
factors are constant, would influence the outcome of aggregate programmatic w;^- 
impact measurls. The strong influence of Pittsburgh upon the aggregate data^^ 
when combihed'with the slight opposite impact of San Bernardino tends to 
' balance each^other in the aggregate data sets. However, in the analyses -^^ 
of aggregate measures of group differences, three sets of t-scores are 
utilized (See Table 13). The first set compares six VEPS cities tthe four ^* 
mentioned above plus Fort Worth and Salt Lake City) against the control . ;^ 

group; the second set compares the four VEPS cities against, the four .counter- / 
part control groups; the third set drops the San Bernardino data for both 
^ VEPS and control groups due to the impact of the selective screening of 

f VEPS applicants in that city. As vill be noted, howeVer, these^ manipula- } 
tions do not jnaterially chan'ge the outcome^, except in' terms of levels of 
significance. ^ ^ / - 

Table ^2 compares frequency d^stributicW-sfor the academic indicators 
for bt>th VEPS-I and the corresponding control^roups during the 1971-72 • 
experimental year and 'the following senior year (1972-73). The N declines 
in 19 7.2-73 due to the number of graduating seniors (el^ther m^d year 1972-73 
or at the end of the VEPS yearO o^ drop-outs in both groups • 

In terms ,of grade point performance, duarlng the VEPS-I year, 62,9% of 
]the (foui^ city) VEPS-I youth improved thei!r grade point average compared 
- . to less than half (47.0%) of the control /group. For the senior year, the , 

distributions among those improving ox declining are virtually the same . j* 

for both groups • The interpretation emerges, therefore, that the VEPS pro- 
gram had a positive impact upon the VEPS-I youth during the experimental 
year and that this -impact continued into the senior year in that virtually 
no difference can be seen in performance of the two groups* It must he 
rememb*ered that, as the t-scores wi'll iridica'te, the VEPS-I group entered 
the program with significantly inferio:|:'' .grade point averages* 

In^ terms of a summary scale, 50.3% 9f the VEPS-I youth improved their , 
G.P.A. -at least a quarter' of a quality point 'during th*e VEPS-I year cpm- 
^)ared't6 ouly 33.8% of the control group. *In the senior^ year VEPS-I youth 
improved an additional quarter of a ptDint'in 48.7^ of the cases compared 
.to 41*8% for the control g^^o^^ Thus, VEPS-I youth improved in G.P.A. not ^ " 
. pnly in absolute numbers, but'^uantitatively as well, a manner s\iperior 
to the control group* - ' ^ ^ * • * ' * 

We have noted in final reports and assessments foix individual program 
years the apparent lack of a relationship between attendance and grade, point 
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Table 12 



Comparison of Change in Academic Indicators for the VEPS-I 
and Senior Years for'VEPS-I Completers" and Control ©roup 



/ - . . VEPS-I . Senior 

\ ' Year* - -Year** 



Academic Indicator ■ -■ VEPS .Control - VEPS' 



Control 



Grade Point Average ^ange (N) (151) (151) ■ (115) (129) 

/^P . 62.9% 47.0% 56.5%. 58.1% 

• i^^^^ » - 2.0 1.3 1.7'- 6.8 

' ' . • ■ 35.1 51.7 ■ 41.7- 41.1 



r 100.0% 100.0% 99.9^ "100.0% 

•Summary Scale G. P. A. Change* (N) J^l) (151) (115) (129) ' 

.+1.26 oir better ■' ' <(l0.6% 4.0% 6.1% 9.3% 

+0.76 to +.1.?5 2a^6 7.9 13.9* -11.6 

+0.26 to +0.,75 . i . 29.1 21.9 28.7 20.9 

-0.25 to +0.25 . * 25.8 31.8 27.8 31.0 - 

-0.26 to -0.75 11.9 20.5 15.7 ' 20'.2 ' ^ 

-0.76 to -1.25 9.9 9.3 4.3 . - 5,4 C. 

-1.26 or worse 2.0 4.6° 3.5 ^ ' 1.6 

99.9% 100.0% 100.0% 100.0% ' • 



Attendance Change ( Vj/ (N) 

Up - r 

Same 
Down 



Summary Scale Attendance Change (N) 
+10 days or more 

+4 to +9 days ' ' " 

-3 to +3 days ^ ^. 

-4 'to -9 days , * 
-10~day'S or more 



(149) 
57.0% 

7.4"- 
35.6 


(146) 
37.0% 
3.4 • 
59.6 


(111) 
■ 50.5%. 
2.7* 
46 .'8 . 


(126). 
3^.7% » 
5.6 
. 54.8 


100.0% 


100.0% 


^ 100:0%" 


100 . 1% 


(149) 


(146) 


(111) ' 


(126) 


32 . 2% 


12.3%- 


25 . 2% 


14.3% ; 


■ 14.8 • 


13.0 


1§.9 - 


11.1 ■ 


22.8 


-33.6 


21.6 


31.0 


10.1 


17.1 


12.6' 


15.9 


20.1 


24.0 


'21.6 


27.8 • 


100.0% 


100.0% 


99.9% 


100 . 1% 



/^Compares 1970-71^with 19*71-72. 

**Compares 1971-72 -with 1972-:73. • - ^ 

Data are for'four VEPS-I cities with, con t.rol grows on]y. 
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performance, and that the program appeared to have had only a marginal impact 
on attendance. The data comparing VEPS-I \^i^th the cpntrol group for attend- 
ance indicafe a somewhat more favorable outcome. During the program year 
well over^haif (57.0%) of the VEPS youth improved their attendance compared 
to only 37,0% of the control group. Moreover, this pattern continues dur- 
ing the ^^enior year where^ again, more than half (50,5%) of the VEPS-I' 
yoath improved in attendance while only]|9^7% of the control group d^.d so. 
Quant ita-tively expressed in terms of a suimnary scale, the difference is 
even irf^jre apparent. While 47:,0% of the VEPS-I youth were imi^roving by at 
ieast four or^-more days in attendance during the VEPS-I year, only 25,3% 
of the control group did so. In the seiAor year, tt^e same pattern holds; 
44,1% of the VEPS-I youth- Unproved a minimum of four days compared to only 
25,4% of the-xontrol group", 

*^ ► ' , 

Table 13 reveals the longitudinal pattern for the VEPS-I and control 
groups for* the G,P,A1 and attendance variables,' Over the two years fol*- 
lowing the 19 70-71 'base year, VEPS-^I youth showed steady improvement in 
G,P,A, in 3^9% of the cases compared to Z0,2% for the control group. And 
converse ly^while 8,9% of the VEPS-I youth show^ .a steady decline over t§he 
period, 1^2% of the control group did likewise^ ^uch the same pattern • 
holds true__in_attendance. While only 13,^6% of ^he control showed steady 
improvement in attendance, 34,7% of the VEPS-I enrollees steadily improved, 
ConveVisely, while 22.1% of the \^PS-I youth showed steady deterioration of 
attendance, 32,8% of the control group did so. 

Thus, utilizing comparative frequency dist^'^utions, the VEPS-I pro- 
gram appears to have had a substanfi^^ 'impact upc5h the enrollees, far tie^ 
yond wha£ would ordinarily be the ';case (as indicated by the control gt^p) , 
Compared to the control group, the differences in performance ^are striking. 
The question remains whether 'this disparate perfqrmanpe among the two groups 
is statistically significant, or whether the apparent) differences are really 
not that dramatic. * \ ' 

^ Table 14 provides T-score tests -for 'the significamce of the unit data 
underlying Tables 12 and 13; In' terms df gjrade point neBcformance in 1970- "^l^ 
comparison of the VEPS-I cities, with the coiitrol groupsV reveals an inSigni-" 
f leant neg^ive bias indicating a superior control group; in the comparison 
of the three VEPS cities (Columbus, Flint and Pittsburgh) ^and their control 
groups, the difference is significant at theglOl level, ^This relationship 
refeults largely from tl^e influence of the PiWsburgh VEPS-I data. In the 
1971-72 experimental year, the t-scoj:es indicate a reversal of the posi- 
tions; VEPS youth^are. no longer inferior to the control group and show a 
slight positive >ias, although the difference is not statistically si^gj^ 
ficant. laiese data Indicate that the program was successful in improving 
grade point pjerfprmance , and (importantly) the* difference! between the groups 
is not significant at that point in 'time , ' The long term Impact of VEPS-I^ 
is shpwn in the t-scores for 1972-73, Once again, there is a slight posi- 
tive biaSx^toward the VEPS youth, although the, difference dls again not statis- 
tically significant, ' , ^ , '^1 

The analysis of change in grade point perf onnan^^ is -more indicative 
of the impact of VEPS.* Change from the base>ear (1970-71) during the ex- 
.perimental year is significant at the \wi level regardlesi of the city 
combinations. The lingering .influence of VfiPS is 'further demonSctrated by 
the fact that no significant difference in* change in grade point performajace 



' Tab 1^3' ' ^ 
Composite Thr.ee Year Academic In<iicato,r Trends* 



Composite Three Year Trend 
(1970-71 to 1972-73) 



G.P.A. 

VEPS 



Trend 
, Control 



Steady improvement 



(N) 



Improved VEPS 
Improved VEPS 
Improved VEPS 
Declined VEPS 
Declined VEPS 
Declined VEPS 
Steady decline 



Stable senior . 

declined senior, but improved over base 

declined senior; below base 

improved senior; over base 

improved senior;^ below base ' 

stable senior , 




Attendance Trend 
VEPS Control 



(95) 
34.7% 

4.2 
14.7 

0.0 
12-6 
11*6 

0.0 
22.1 
99.9% 



.(125) 
13^6% 
V 2*4 
5-6. 
16^0 * 
16*0. 
10.4 

* 3.2 
32.8 

100.0% 



*Four VEPS^ cities 'witli'- control groups only. 
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•■ Table 1^ 



.1. 



^-Score 


Comparisons of.VEPS and Control Group Aggregates for Academic Indicators 
•By Year and By Change Over TiEgye , ^ 


.Academic Indicator 




Six VEPS/ 
.Four Control 


Four VEPS/ 2 
Four rinn^Tnl 


Three VEPS/ ^ 
inree Lioncrox 


Grade*" Point Aveir^ge 
• 1970-71 
1971-72 
.1972-73 

Change in Q.pIa. 
1970-71/71-72 
.197±-J2/J2-7lr 
1970-71/72-73 

■--•-4------ 


0 ' 
K 


-0,2233 * • 

3.3948**** 
' 1.4538 

* * 

3.9996**** 
-Q..2516' - . 


.-1.4993 
1.8786* , ■ 
1.5758 

. # 

3.5416**** 

0.0258 

2.5560*** 


-3.9987**** 
, '0.'4255 
0.6051 

. . ' ( ■ 

C^ 4.2836**** 
0.6216 
3.6575**** 


Attendance* * 




✓ > 
■ 4 







~a970-71 
r 1971-72. 

*>'1972-73 «- 

Change, in Attendance 
1970-71/71-72 
3^71-72/72*73 
19.?0-7K72-73 . - 



2.8217*** 
-0.1il3 
-0.4368 



-3.4792**** 

-1.8738* 

-3.6695**** 



3.5263**** 
0.1770 
-0.9422 



=3,. 8780**** 

-i:2766 

-3.4244**** 



3.2595**** 
-0'.3065 . 
0.3187 



-3.7712**** 
0.2600 
-lrr95^4* 



Data are for. the four VEPS -cities with contrbl'^oqps plus Fort Worth and Salt Lake City VEPS, 
, \ ^Data are for 'the foi^f VEPS cities with control groups only. , ' * ' 

. ?Data exclude San Bettiardino*" VEPS and control groups. • * ' • 

' ' • „ ■ ' ^ 

Symbols.f'^' . .' . ' ' , . 

* = 'significant at the .05 level ' . -' " ' * o ' 

** * s.ignificant at the .-02 level • - " 

*** = significaint at tfie. .Ol.level,- . ' ' . 
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occur.s over G.P.A. performance in 1971-72 compared to 1972-73. When over- 
•all 'change is measured from 1970-71 through 1972-73,. the longitudinal impact 
of the, program is apparent. Although' the diff erences , between^ the groups 
vary with grouping of cities examined, a comparison of the four VEPS cities 
with their corresponding control groups shows significance at the .01 level; 
when San Bernardino is removed (and, therefor^, the influence of the Pitts- 
burgh data ' enhanced) , the leltel of significance rises to the .001 level. 
Regardless of groupings, then, the analysis of cliange in grade point per- 
formance indicates a significant positive and long term impact upon the VEPS 
enrollees . . * . w 

We have on occasion suggested that VEPS had only marginal impact upon 
attendance patterns, and that the relationship between attendance and grade 
poinr'p^rformance was only weakly positive. Analysis of the t-scores com-;' 
paring the \(EPS-I and^ control groups is indicative of a much more substan- 
tial impact than we had previously maintained. In examining the base year 
data (1970-71), the difference between the groups is significant at the .01 
or the .001 level depending upon which grouping is used; VEPS-I youth were 
thus significantly more prone to be absent from sqhool than was the control 
group prior to the experimental year. In the 1971p72 expetimental year, 
this difference disappears, so that both groups arfe^, comparable in school 
attendance. This pattern continue^to hold true for thp year following 
^he VEPS-I progr^am. In fact, there i^ a slight positive impact in that 
the VEPS-I youth were less pvorie to irfiss school than the control group, 
although the difference not statisti>cally' significant. 

The real impact of VEPS emerges in analyzing change, in attendance pat- 
terns over time. Comparing the VEPS-I year to the base'year, significant 
(.001 levSl) improvement among the VEPS-I youth can be observed. Change 
from the VEP5-I year through the senior year continues to show improvement, 
although not at a statistically significant level. In other words \the im- 
pact of VEPS-I was to radically imprpve performance among the VEPS-I youth 
durinl^ the experimental year, the effect of which petsisted through the 
senior year. * Very little recidivism occurred. Comparing change over the 
period 1970-71 through l972-73^the difference is statistically signifi- ' 
cant at the .001 level, ''except m the three city comparison.' In summary, 
VEPStI proved to have significant and long term beneficial impact upon the 
school attendance patterns of ^ the VEPS-I youth. 

In exploring this finding further,^ we attempted to account for the 
variation from previous observations. It is apparent now that VEPS ha(^sub- 
,stantial impact upon youth who previously had missed a considerable nymber 
of days from school and only marginal impact on those youth whose attendance 
pattern was more ndrmal. Thus, wh?.le maintaining the normality of attend- 
ance patterns among most of the youth, the program also resulted in substan- 
tially improved attendance amcmg those youth who had been mast. truant. It 
is the dramatic improvement among these, youth that accounts for; the high 
level of significance in the analysis of change* It might be suggested 
that improved attendance is the consequence of one of the operating norms 
of VEPS-I programs — no sqhool, then no work and no money. > y-q 

B« Final Academic Disposition 

Important as grade point performance and attendance may be -as indi- 
cators to assess the impact of VEPS upon the attitudes and behavior of the 
enrollees, the ultimate test of programmatic impact rests in the extent to 
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Final Academic Disposition for VEPS-I CoiQpleters and the Control -Group as .of June, 1973 



Disposition 



First Grouping . 
VEPS Control 



Second ISrouping v 
VEPS , Cont4roI>v 



Third Grouping 
VEPS Control 



Graduated, 1972 
Graduated^ 1973 / 
Not graduated, could have 
No.t graduated, could not have^ 
Dropbut 
Total 



27.9% . 
54.3 \, 

3.6 

5.3 

8.9 


— %♦* 
75.3 
6.7 

4,0 • 
14'.'0 " . 


^ 8.6%- 
'65.1- 
.3.9 
8.6 
.'■ 13^8 


— % 
75.3 

6.7 

4.0- , 
14.0 


12.4% 
57.1 
4.8 
• 10.5 
15.2 


— % 
75.0 
7.5 

■ 5.0^* 
12.5 


100.0% 


100.0%- 


. 100.0% 


• 100.0% 


IOQ.0% 


100.0% 


(247) 


(150)' 


(152) 


(150) 


(105) 


(120) 



~ ' ^ 

1 ^ - • • ^ ' ^ . • ' , . 

rincliides six VEPS cities and the four control groups. 

^Includes^Che four VEPS cities witfi their corraspon4JLng control-gi«)ups>. * ^ ^ 

^Excludes th^ San Bernardino VEPS and control groups. ^ 
.^Represents sopbomores in the .VEPS-I year. ^ ' 

*To be included in the control group, a youth had tio be im 'school during the 1972-73 academic year. 

■ r 



whi-ch VEPS-I attained its two principal Academic objectives: did the'en- 
rollees stay in school, and' did they graduate? 'Since no methodology exists 
to run a double blind (test what would have been' the case without VEPS) on 
the VEPS-I enrollees, an assessment can only be attempted by using a control 
group for comparison. . . • 

Given the. fact that the VEPS program was intended to serve dropout 
prone youth. evideTice of a ppsitive programmatic* impact must be* based on 
the presuipption that without VEPS more youth would haye/^??opp^d^ out >and 
fewer would hava graduated. From this 'standpoint, ivf" i'^ii^ be shown that 
VEPS-I youth were less prone to^ drop out and more prone t^'g^tduate than 
-the control group, the impact of the program would hav^.di^^e;ded expecta- 
tions. More likely as an expected positive result wouiIl^ the determina- 
tion of no discernable or meaningful difference between .tlife;' VEPS group .aid 
the control group, ^ .V<V-^5& ' . 

Table 15 provides frequency distributions on f irfei.<^^adem,ic disposi- 
tion as of June, 1973, for the VfiPS-I and control g^^'||f.|/c;9nsistent with, 
previous analysis, we have, utilized various groupirigl^Sr * ^he -VEPS-zI cities 
in order to mitigate the influence of data nuances , /The comparison 
rests in 'the four VEPS-I cities versus their comparable coatrol'-groups ; 
in that comparison very littl^ difference between the group^" can b^^ observed. 
It should be mentioned, in passing, howaver, that a small nutnS'e.r of .||he 
VEPS-'I enTollees were seniors when th*ey were recruited for the progr^iiv'; 
'these youth were graduated in 1972 rather than the expected ^1973 date i^ 
the guidelines had been rigorously followed. Nevertheless, ,the key inter- 
pretatlon is simply the lack of' any observable difference beitween the two 
groups in terms of graduating or dropping out. ♦ . \ 

\ ' * 1 

Although the marginal frequencies would indicate tha\ nc^ significant 
di^stributions exist, Chi square tests were run on data for ii^dividual cities 
as well as the various groupings, of cjties. Final academic disposition data 
were dichotomized' into gradua^ted and not graduated to overcome small cells' 
and data nuances;' youth whq could not have graduated under. an^ circumstances 
were excluded. Small cells hampered computation in the four tities for 
which control groups exist, rendering it impossible in two of | them. In 
the other two, ho significant difference coufd be found. Only in th6 case 
of the six VEPS-I cities and the four control groiips could a significant 
Chi square statistic (at the ,05 l^vel) be found; comparing the four VEPS-I 
cities 'against the counterpa'rt control groups and comparing tHe same data 
excluding that from San Bernardino yielded Chi .square levels dff significance 
ofV-70 and <.80 respectively. ' ^ . \ 



In short^, thenj in terms of final academic disposition, np meaningful 
difference can be found in comparing the graduation rate for VfiPS-I gr<5tip 
with the control' group. This should be interpreted as' a positiive outcome 
for the VEPS-I program in that youth selected for the^prl)gram wfere more 
likely to be "probable dropouts" than were youth in the. controllgroup. 

C . Emplpyability in the Full-Time Work Force ' \ 

While the school oriented objectives of VEPS constitute one^^^major 
emphasis of the program, the* f ina^ objective lies in the' area of youth 
employability t Briefly stated, the objective of VEPS was to take\ d^rop- 
out prone youth reorient them toward completion of a high schoo*l\,e*duca- 
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tion, and ease their transition into the full-r'time labor force. It^/Tas 
tf*' hoped that the work experience ^and couriseling received during ,VEPS-I would 

provide the youth with marketable skills to enhance full-time employment 
* \ possibilities and thereby interdict the flow of unskilled youth into the 
•labor pool. ' / ' • ' ' ' 

. '""^ • 

» , In Paft III of this report we reported that 50.3% of the VEPS~I com- 
pleters who graduated were empl^f^ed full-time in the private sector, while 
another 1.%% held public sector employment. Overall favorable outcomes 
l^xcludes unemployed and "other" categorie^^) totaled *37 . 2% of the youth. 
Only 10.4% of the VEPS-I completers were unemployed at the time of the SJur- 
vey. Although interpretation bred of an awareness of the problems of un- 
employment among high school graduates would >iicta{:e that the 10.4% unemploy- 
ment rate is comparatively low, the question/ still remains whether these 
" out-cpmes for VEfS-I youth are substar^tially l^ifferent from those of other 
NYC Vouth. ' 

o . , • 

f 4 

. / To achieve" 'comparab^ility of enjploymen't data with the cOhtrol group, 

the data* were collapsed into tliree categories: employed, unemployed' and 
other; vthe, other category included military service, higher, education, 
married, mov^d and untraceable. The frequency distributions for these cate- 
gories are* pr,Wided in the upper half of Table 16, organized under the vari- 
ous »city groupings. The first grouping compares six VEPS cities with the 
four control gro*ups; the second grouping compares the four VEPS cities withV 
their comparable control groups; and the third compares r thAree VEPS cities 
and their control groups, excluding the data from San Bernardino. The com- 
'parabjLlity among the distributions regardless of city groupings is apparent 
from the data. To^test the significance of the distributic^ , Chi square 
tests were run fdr each grouping, and in each case the level of significance 
was, greater than .001, In other v^rds, the fact, that more VEPS youth were 
employed and fewer unemployed is statistically signif icant^and Is indica- 
tive' of a substantial prograimnati(i impact. ' ^ ^ ^ 

To .eliminate the influence of the Vother" category in tKe distribu- 
tion*, the data were dichotomized by eliminating "the "other" category from 
the analysijS. The resulting distfribution is found iti the bottom hal^ of 
Table 16. Once again, the marginal frequencies are quite comparable across 
' the city groupings.- A Chi 'square test was run pn the distributions and 

*again revealed^a high level of statistical sign^if icanc^— at the .001 level 
. f or the first two groupings and the .01 level for the third grouping.' No 
Chi square tes'ts* could be run' on the datsa for individual cities because of 
* " small expected frequencies in individual cells, ^us the elimination of 

the "other" category did not materially influence the levels gf s^tatistical 
significance. Even assuming all untraceable VEPS-I and contrdj group youth 
^/ were employed does. not change levels of significance. . 

' "i!:^ Base^ on these employabili,ty data, therefore, the conclusion may be 
drawn that a significant difference exists between the VEPS-I and control 
groups, in terms of employability .upon" graduation from high school, and 
this difference may be attributed to the impact of the VEPS-I^ program. 
Thi^ outcdme may be hedged slightly by the fact that over half of the em- 
ployed VEP5-I youth retrained at their VEPS-I employer, indicating^ that , the 
mere fact of placing a youth in a private sector work setting is conducive 
to maximizing -employability. But this hedge on the programmatic impact 
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Table 16 * , ' 

Final Employment Disposition for VEPS-I Completers and^the"" Control Group as of June,' 1973*. 



Employi 


nent Disposition 


, 

First Grouping"^* 
VEPS Control 


2 * 

Second Grouping 
VEPS Control 


Third Grouping"^ 
VEPS . Control 


Emp! 
Oth€ 


loyecj 

r , , ' 


52.9% 
36.. 4^ 


29.6% 
40.0 


^53.6% 
30.4. 


' 29.6% 
40.0 


59.3% 
22.1 


30.0% 
38.0 



Unemployed 

/Total 

(N) 

P 



10.7 ^ 30.4 

ioo7d%x,^JIoo7o% 

(206) (115) 
<.001 



16.0 
100.0% 



30.4 
100.0% 



{yi5T (115) 

< .001 



18.6 
100.0% 

^ (,86) 



32.0 
100.0%/ 

(100) . 



-<.001 



Employed 
Jliiv^mployed . 
' Total 

(N) . 

P 



83.2% 
16.8 



49.3% 
50.7 



100.0% 100.0% 
(131)' ■ ' (69) 
<.001 



77.0% 
23.0 
100.0% 

(87) 



49.3% 
50.7 

10073% 

(69) 



< .001 



■'■Includes "fi^VEPS cities and th^ four 'control grokps. ■ ■ 

^Includes the foun-VEPS cities with their corresponding control groups. 
^Excludes, the San Bemardp.ivo VEPS and c\)nt,rol groups. 




V 



) 



*To be included in the- control group, a y/outh had to be* in school' during the Vill~12, academic' year . 



i 

/ 



of VEPS-I must xtseM be modified^-n light of the fact that most NYC youth 
are effectively precluded from participation in regular work experience 
programs. .The desirability of on-the-job training to ease^ the post^^rain- 
mg placement problem is also confirmfed by this outcome. ' * 
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PART V 



SUMMARY ;AND CONCLUSIONS 



/ 



The preceding analysis of the longitudinal impact of the VEPS-l' pro- 
gram on ^rollees in the first experimental year (1971-72) encompassed two 
main concerns: specific ordtcome^^^ojt the youth enrolled in the VEPS-I 
program^ and, the significance* of those gutcomes compared to^ the experiences 
of a control group of NYC enrolle^s. The longitudinal character oflthe 
assess^nt used the 1970-71 school year as a baseline; the academic knd 
attendan)5^ behavior of the VEPS-I completers was plotted over timfe through 
the 1971-A^experimpntal year ^nd the following 1972-73 senior year df high 
^-school. These youth wera tracked 'to determine whether, in fact J the^ grad- 
uated from high school, did not graduate on time, or dropped outS)f sfchool. 
Were appropriate, academic outcome data was compared to similar data\for 
the control group. * .1 \ 

Longitudinal information was also collected pertaining to^ the employ- 
ability of the VEPS-I youth subsequent to the program and upon grajjuation. 
Employment status for the VEPS-I completers was plotted for. f^ur points\ in 
time: at the close of the VEPS--L experinlental year, during the summer fol- 
lowing the experimental year and preceding the s'enior year, during the W 
senior year of high school, and after graduation. Again where appropriate,, 
data were collected for the control group and used f or Icomparative purposes. 



ilysis oi 



The general conclusion to b.e drawn from the analysis of the .above data 
is that the VEPS program proved to be an effective, significant, and lasj^ 
ing experience for the youth who completed the program, resulted in signi- , 
ficant improvement in academe performance and attendance in school, and ^ 
contributed significantly^ to the ability of the VEPS-I youth/ to obtain fuii- 
time employment upon graduation from high, school . 7"^ \ 

rh±s assessment of the VEPS 'pro§;ram is based -^n careful, analysis of ^ 
data representative of the primary objectives of the. program. We may sum- 
marize these objectives as follows: 

1. To improve academic performance and attendance in school by means * 
of dertjnstrating to d-^pout prone youth the value of a sound high school . 
education through work experience and intensive '^counseling; f * 

2. To reduce the propensity of sueh youth to drop out and to encourage 
them to' obtain fi high school diploma; ' . . 

3. ^ To provide, meaningful work experience to enhance the work skills 
and attitudes of th^ enrollees; 

4. To provide part-time employment to the youth while in school; and 

- 5. To enhance the ^lity of the youth to secure full-time employment 
. u^n- graduation. - , , ) . , ' . 



The analysis of the longitudinal and outcome d^.ta confirms' that the \^EPS 
program succes^f ujjlLy attained each of the objectives, frequently at a level 
superior to whatTOightl otherwise be expected^ We may summarize the analysis 
findings" as follows. ' 



The impact of VEPS-I upon grade point performance was both significant 
and widespread. Dramatic improvement over the 1970-71 base year Was charac- 
teristic of the VEPS-I youth during thd experimental year; the impact of 
this change persisted tlhrough the following Xsenior) year. Both frequency 
distributions and tjrscc^re tests confirm this observation at' a statistically 
significant level. Ovgl^ail improvement ^irT^ade point performance from 
1970-71 through 1972/73^ is' also statistically significant. The net result 
is that the VEPS-I pprogram was instrumental in improving the grade point 
averages* of VEPS-I yputh to the point that they assumed a superior position 
oyer the control grx)up in contrast to their inferior position during the 
baseline year. The analysis of differences between the two groups for only * - 
the 1972-73 (senior^) year reveals'a positive bias toward 4:he VEPS-I group, 
although no statistical significance can be attached to the distribution. 
Analysis of change* in grade point .average -over the entire time spectrum 
does result in a high level of significance in favor of the VEPS-I group. 
This relationship holds true regardless of the combinations of cities analyzed 

Much the same findings occur i;n analysis of attendance data. In 1970-71, 
the baseline year,^ the control groujp was significantly superior to the VEPS-I 
completers in te-rms of attendance patterns. Through each of the follow- 
ing two years this significance,^ was \eliminate(^, and the data indicate a 
slightly su|)erior posi^tlon for the VEPS-I group.. Analysis of chani^e in 
^ attendance patterns also yields high '^statistical significance. Although 
previous observations had been made tihat the impact of VEFS-T upon attend- 
ance patterns had been slight but positive, the implications of the change 
data are that VEPS-Is«j>ad k significantly positive impact upon VEPS-I youth 
attendance patterns. 

Significant as these quantifiable indicators are, the ultimate test of 
the academic impact of the VEPS program rests with only one outcome — whether 
the youth graduated or dropped out of school. Virtually no differemce exists 
between the contrpl group and the VEPS-I group in terms of either gradua- 
tion rates or dropping out. Therefore, given the fact that VEPS was tar- 
geted for youth who we're p-robable drppoutis as evidenced by lower pre-program 
indicators, the conclusion is forced that yhe VEPS program reducTed the pro- 
pensity for VEPS youth to drop out of school and materially contributed to* 
their earning high school^diplomas . ' , 

' The employability data ari^ no less striking than that \Dn academic per- 
..formance. VEPS was intended to provide part- tinie^^ployment during the 
VEPS-I year, full-time summer employment in the summer intervening between 
the VEPS-I year and the senior yBar, part-time employment in the senior year,: 
and full-time employment upon graduation from high school. Part TXI of 
the report contains daVa indicating that the program was successful^in the 
first thrSe' of these fobr employment-time objectives; part of this success 
can, howe.ver,,., be ^t t i' ib iited to ,^ continuation pf VEPS 'into d second year. 
No -control group^ Jtuf ormation was pertinent to thes.e VEES cjbjectiv^s. The 
ultimate objective for which comparative data can be generated is. employ- 
ability upon giriduation, representative of a smooth transiticm from high - 
school into the full-time' labor.force. Regardless of the combinations of 
cities analyzed, at least hal^f the VEPS youth .were. jeinployed full-time 



compared to approximately thirty percent of the control group* Unemploy- ' 
ment among the control group was nearly double that of. the VEPS group. Both 
Chi square tests on the distributions and simple examination of the marginal 
frequencies yiePd the /ame , conclusion: VEPS youth were employed at a signi- 
fica'ntly higher rate than was the control group. 

Along all dimensions of programmatic objectives, then, the data indicate 
a highly successful VEPS-I experiiuer^t^ The data re.veal significant improve- 
ment in.^rade point performance and in attendance patterns, no discemable- 
"^jlfference with the control group in graduation/dropout patterns <although 
VEPS-I enrolled probable dropouts), and significantly greater ability on 
th^ part of VE?S-I youth to- ob t«ain - full-time employment upon graduation. 
In January, 1972, approximately six months into the VEPS-I experimental 
I year, the Center for Urban Programs prepared an assessment paper for the 
I Department of Labor to facilitate a decision whether or not to contin\ie the 
IVEPS program into a second year. In that pape^^ seven preliminary observa- 
Itions were made; it Vas conten'ded that the VEPS-I program resulted in: 

1^* - Reduced the tendency among VEPS-I youth to drop out' of school; 

2. Significantly improved academic achievement among VEPS-I enrollees ; 

3. Significantly improved s^ool att^dance patterns; 

4. ' . Improved disciplinary ^atus among the enrollees; - ' 

5. Realisti(r^attitude development and growth in individual responsibility; 

6. Private sector woirk experience not rtormally available to the VEPS-I 
^participants; and ^ , 

7. Enthusiastic support of VEPS program personnel. 

Analysis of the outcome data confirm the validity o,f these early state- 
ments • To these may' be added two more; VEPS-I resulted in - • i 

8y Higher than expected graduation rates and lower than expegted drop- 
out rates ;, -and/ - • 

9. Significantly higher employment rates among VEPS-I enrollees tha'n 
within a comparable .control group A , 
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APPENDIX 
Table 



COMPARISON OF VEPS PROGRAMMATIC OUTCOMES 
FOR VESS--I AND W?S-1J, COMPLETERS * 



rogrammatic Outcomes 



GENERAL OUTCOMES 
Completed 
Terminated 
Dropout 

Total 

m ^ 
academic" outcomes . 

Direction G^P^A. .Change 
Improved 
Unchanged 
Declined 

Total 

* Actual G^P^A^ Change 
+1*26 or more ^ 
+0-76 to +1^25 
+0-26 to +0-75 = ' 

+0-25 to -0-25* 
-0-26 to -0-75 
-0*76 to, -1.25 
-1.26 or more 
Total 

attendan,ce outcomes 

Direction At t. Change 
Improved' 
Unchanged 

Declined ' * ' ^ 
Total 

Actual At t* Change ^ 
+10 ^ays or more 
+4 to +9 ' , 

+3 to -3 

-4 to -9 V 
-10 days or more\^ ^ 
Total ^ . 

FINAL DISPOSITION 

At VEPS Employer ^ 

©ther .Private Sector 
, Returned to NYC 
7 Higher Education 

ITot Working 

Military 

Other 

Total 



Program Year 
VEPS-f VEPS-II 



ERLC 



63.1% 
27.2 
9.7 



53.9% 
36.2 
9.9 



100.0% * .100.0% 



61.8% 

2.8 
35.4 



62. Q% 

6.0 
32.0 



100.0% 100.0% 




9.1% 
12.2 
26.8 
: 28.3; 
13.4 ' 
7.5 
2.8 
100.1% 



49.8% 

4.9 
45.3 



100.0% 



26.5% 
13.5 . 
22.0 
13.1 
24.9 



8.9% . 
14.4- 
23.4 
29.4 
13.^ 
. 7.8 

100.0% »' 



48.8% 

6.5 
44.7 
100.0% 



18.8% 
15.3 
32.8. 
14.3 ■ 
18.8 



100.0% . 100 



37.2^ 


69.0%, 


4.3 


6.3 - 


43.8 




6^2 


6.p/ 


4.3 


8.4- 


2.3 , 


2.4 • 


"1.9 


2.4 


100.0% 


100.0% 
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Dif ference 



- 9.2% 
*+ 9.0 
+ 0.2 



+ 
+ 



0.2% 

3.2 

3.4 



0.2% 

2.2 

3.4 

1.1 ' 

0.1 

0.3 

0.2 



J 



- 1.0% 
+ 1.6 ^ 

- 0.6 



- 7.7% 
+ 1,8 
+10.8 
+ 1.2 

- 6.1 



+31.8% 
+ 2.0 
-38-; 3- 
- 0.2 
+ 4.1 
+ 0.1 
+ 0.5 , 
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